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CHAFfER  1 


INTRODUCTION 


In  this  dissertation,  we  consider  an  alternative  to  the  (s,S) 
ordering  policy  associated  with  inventory  systems. 

The  (s,S)  ordering  policy  is  specified  as  follovjs.   There  exists 
a  store  of  finite  capacity  S  that  holds  material  (discrete  or  continuous) 
for  future  use  in  some  process.   In  the  most  general  context,  demand  for 
the  material  in  storage  during  an  interval  of  time  is  assumed  to  be  a 
time-dependent  stochastic  process.   Ordering  of  replacement  stock  to 
maintain  the  level  of  inventory  in  the  store  is  done  in  one  of  two  ways. 
Either  orders  for  an  amount  S-s  of  replacement  stock  are  made  at  the 
times  when  the  stock  level  reaches  s,  s  ^  S,  or  the  level  of  stock  in 
the  inventory  is  examined  at  regular  points  in  time  and  orders  for 
replacement  stock  equal  to  the  stock  deficit  are  only  made  at  those 
regular  times  for  which  the  stock  has  fallen  below  the  level  s.   In 
both  cases,  the  time  it  takes  the  replacement  stock  to  arrive  (i.e., 
the  delivery  time)  is  assunied  to  be  zero.   A  generalization  of  the 
(s,S)  ordering  policy  allows  a  time  lag  T  for  arrival  of  the  replace- 
ment stock- 

For  a  certain  class  of  cost  functions  associated  with  maintaining 
the  level  of  stock  in  an  inventory,  it  can  be  shown  that  the  (s,3)  order- 
ing policy  is  the  optimal  policy  to  utilize.   A  summary  of  some  results 


for  the  (s,S)  ordering  policy  and  conditions  under  which  (SjS)  is  (or 
is  not)  the  optimal  ordering  policy  is  given  in  a  paper  by  Gani  (1957). 

Another  generalization  of  the  (s,S)  ordering  policy  is  the  fol- 
lowing.  The  capacity  of  the  inventory  is  S  and  demand  for  the  stored 
material  is  once  again  a  time-dependent  stochastic  process.   Hov/ever, 
orders  for  an  amount  v  (v^S)  of  replacement  stock  are  now  made  at  the 
times  when  the  stock  level  drops  to  the  values  S-v ,S-2v ,S-3v,  .  . .  .   The 
delivery  time  for  any  order  is  assumed  to  be  a  constant  value  T  (T^O). 
Under  the  assumptions  that  the  store  holds  discrete  items  and  the  demand 
for  these  items  obeys  a  Poisson  probability  law,  the  long  run  probabil- 
ity law  representing  the  level  of  stock  in  the  store  is  given  in  Gani 
(1957)  and  Prabhu  (1965b). 

In  many  cases,  however,  a  constant  delivery  time  does  not 
adequately  express  reality.    Furthermore,  the  negative  stock  level 
that  can  arise  when  T  (the  delivery  time)  is  greater  than  zero  may 
reflect  the  loss  of  considerable  time  and  money  in  terms  of  idle  man- 
power and  equipment.   To  circumvent  these  difficulties,  an  alternative 
ordering  policy  is  defined  and  its  properties  examined  in  this  paper. 

Envision  a  subwarehouse,  maintaining  an  inventory  of  finite 
capacity  S,  that  holds  material  (discrete  or  continuous)  for  future  use 
in  some  process.   In  the  most  general  context,  we  assume  the  demand  for 
the  stored  material  is  a  time-dependent  stochastic  process.   In  order 
to  maintain  a  stock  on  hand,  orders  for  an  amount  v  (v^S)  of  replacement 
stock  are  placed  with  a  warehouse  at  the  times  when  the  stock  level  drops 
to  S-v,S-2NJ,  .  .  .  ,S-v[s/v]  ([x]  the  integral  part  of  x).   The  time  it  takes 


the  warehouse  to   process    an   order   placed  when   the  stock   level    falls    to 
S-v,S-2v ,  .  .  . ,    or  S-v[S/v]+v    is    called   a    regular   service   time.      All 
regular   service  times    are  assumed   to  be  mutually   independent   random 
variables   with  a   common  distribution   and   to  be    independent   of   the 
demand   process.      An   order    placed  when   the   stock   level    falls    to  S-v[S/v] 
is    called   an  emergency   order.      The   time   to   process   an   emergency   order 
is   assumed   to  be    instantaneous,    or   at    least   effectively   zero. 

Hence,    regular   orders    for   an   amount   v   of    replacement   stock   are 
made    if   the   stock   level    is    at    least   v   at   the    instant    an   order    is    placed, 
while  an  emergency   order    is   made    if   the  stock   level    is    less    than   v   at 
the    instant    the    order    is    placed.      Utilizing    this    reordering   technique, 
the    inventory  maintains    a   positive  stock   level   at   all    times. 

Although  a   somewhat    larger   cost   would    quite   naturally  be    incurred 
with  emergency   orders    than  v/ith  regular   ones,    it    is    assumed  we  arc  will- 
ing  to   pay  the   price   of    instantaneous    delivery   in   order   to   avoid  the 
disaster   of   running   completely  out   of   stock   in   the    inventory. 

The   cost   of   maintaining   the    inventory    level  will    clearly  depend 
on  V,    the   size   of   a   replacement   order,    and   there   should   exist   an   optimal 
value   of   V,    defined   to  be   that   value   of  v    for  which  this    cost    is    a  min- 
imum.     In   Chapter   5,    we   define   a  v-dependent   cost   function   for  which  we 
seek   the   optimal   v. 

It  will   be   shown    later   that    the    inventory  problem   is    closely 
related   to  a   problem   in   queueing   theory--queueing  systenis   with  balking 
at    queues   of   a   fixed   length.      We  shall   now  discuss    the  salient   features 
of   such  a   queueing  system. 


Utilizing   a    notation    proposed   by   Kendall    (1953),    by  "the    queue 
A/B/s   with  balking   at    queues    of    length  K-1"  we   mean   a    queue ing   system 
specified   as    follows.      The    queue    length  at   any    instant   will    refer   to   the 
number    of   people    in    the   system  who   are   being   served   or  waiting   to  be 
served    at    that    instant.      Successive    customers    are   assumed   to   arrive    in 
the   system    in   such  a  way  that    their    inter-arrival    times    arc  mutually 
independent   with  distribution   function   A( • ) •      A  customer    joins    the    queue 
if,    at   the   instant   he   arrives,    there   are   less    than   K-1   persons    already 
in   the   queue.      If   there   are  K-1    persons    in   the   queue  when   the   customer 
arrives    (so  that   he    is    the  K-th  person    in   the   system),    one   of   three 
equivalent   things    happens    to   him:      (1)   The   customer   balks,    i.e.,    he 
leaves   without   waiting   to  be  served;    (2)   The   system   rejects    the   customer; 
or   (3)   The   customer   receives    instantaneous    service.      There   are   s   servers 
available   to  wait    on   customers    with  the   first    free   server   attending   the 
customer   at   the   top   of   the   queue.      The   length  of   time  from  when   a   server 
starts    to  serve   a  customer   until    the   completion   of   such  service   is    called 
the  service  time.      All   service   times    are  assumed  to   be  mutually   independ- 
ent with  distribution   function  B(-).      Finally,    the  service   times    and 
inter-arrival    times   are   assumed   to   be  mutually   independent. 

Because  the   statistician    is   more   familiar  with   the   terminology 
of   queues    rather   than   inventories,    the  work   has   been   carried   out    in   terms 
of   queueing   theory.      The   times   between   successive   orders    and  the  service 
times    for   the   inventory  problem  with  emergency   orders    are   shown  to   corre- 
spond  to   the    inter-arrival    times    and   service   times,    respectively,    in 
queueing   systems   with  balking    at    queues    of    a    fixed   length.      The  mechanics 


of  inventories  have  led  us  to  give  prime  attention  to  the  queues  GlAl/1, 
GI/M/"",  and  GI/D/l,  all  with  balking  at  queues  of  length  K-1,  where  GI 
(or  G)  refers  to  a  general  distribution  function,  M  refers  to  a  negative 
exponential  distribution  function,  and  D  refers  to  a  distribution  whose 
mass  is  concentrated  at  a  single  point. 

An  inventory  or  storage  area  is  normally  established  with  the 
assumption  that  it  will  be  in  operation  for  a  long  period  of  time. 
In  choosing  a  reordering  policy,  therefore,  long  run  distributions 
becOQie  important.   Fortunately,  this  means  that  long  run  properties  of 
queues  with  balking  are  adequate  for  the  solution  of  our  inventory  problem. 

In  Chapter  2,  the  queue  GlAl/1  with  balking  at  queues  of  length 
K-1  is  discussed.   In  particular,  we  utilize  the  concept  of  an  imbedded 
Markov  chain  to  derive  properties  of  the  queue  length  and  the  time  between 
successive  balks.   In  Chapter  3,  the  same  is  done  for  the  queue  GI/M/<» 
with  balking  at  queues  of  length  K-1. 

In  Chapter  '4,    the  queue  GI/D/l  with  balking  at  queues  of  length 
K-1  is  discussed.   Here,  the  concept  of  the  waiting  time  in  the  system 
is  introduced.  We  again  utilize  an  imbedded  Markov  process  to  obtain 
properties  of  the  waiting  time  and  the  time  between  successive  balks. 

In  Chapter  5,  we  consider  the  inventory  problem  when  the  stored 
material  is  discrete.   Here,  we  forge  the  link  between  queues  with  balking 
and  inventories  subject  to  instantaneous  emergency  orders,  and  give  solu- 
tions for  the  cost  function  associated  with  the  inventory  problem  based 
on  results  from  Chapters  2  through  4,  along  with  some  examples. 


In   Chapter    6,    the   continuous    inventory    problem  and    its    relation 
to  results    of   previous    chapters     is     discussed.      Also    included   are   some 
properties    of   a   continuous,    non-negative   stochastic  process   with  an 
infinitely  divisible   distribution. 


CHAPTER   2 


THE    QUEUE   GI/M/1   WITH  BALKING 
AT   QUEUES    OF   LEi'JGTn   K-1 


2  . 1      The  Basic  System 


Consider   a   queucing   system   in  which  custoaiers   arrive   in   the 
system  at   times,     ...,ct   2'^_i ''^O'^^l '^2  '  "  '  " '    ^"'^'^^  ^^^^   ^^^    inter-arrival 
times 

u.   =  a^   -  o^_^,      3  >  1,  (2.1.1) 

are  mutually  independent.   The  distribution  function  of  u.  will  be 
denoted  by 

Pr  [u.  s  u}  =  F(u),   u  s  0,   j  s  1.  (2.1.2) 

One  server  is  available  to  handle  the  needs  of  the  customers. 

This  server  dispenses  his  service  on  a  strict  "first  come,  first  served" 

basis.   The  successive  service  times  of  customers  who  join  the  queue  are 

denoted  by  w  ,w  ,w  , . . . ,  and  are  assumed  to  be  mutually  independent  random 

variables  that  are  independent  of  the  arrival  times.   The  distribution 

function  of  w .  is  assumed  to  be 
J 

Pr  [w.  ^  w]  =  1  -  e"^",   w  ^  0,   j^l.  (2.1.3) 

Let  {Q(t);-"<t<+=°}  be  the  stochastic  process  such  that  Q(t) 
represents  the  number  of  customers  in  the  system  at  time   t  and 
{Q*(t);  -<=  <  t  <  +™}  the  stochastic  process  such  that  Q  (t)  represents 


the  queue  length  at  time  t.   Recall  that  the  queue  length,  Q*(t),  is 
the  number  of  persons  being  served  or  waiting  to  be  served  at  tiiae  t- 

A  customer  arriving  in  the  system  at  time  cr  enters  the  queue 
if  and  only  if  Q*(ct_0)  ^  K-2,  that  is,  if  and  only  if  the  number  of 
people  in  the  queue  immediately  prior  to  his  arrival  is  K-2  or  less . 
In  this  case  we  have 

Q*(CT)  =  Q(a)  =  Q*(a-0)  +  1  -  Q(c7-0)  +  1. 
If,  on  the  other  hand,  our  customer  is  faced  with  a  queue  length  of  K--1 
(so  that  he  becomes  the  K-th  person  in  the  system),  he  balks  and  imme- 
diately leaves  the  system.   We  now  have  that  Q(cf)  =  K  implies 

Q(a_0)  =  Q(cr+0)  =  K-1 
and 

Q*(a-0)  =  Q*(o+0)  =  Q*(a)  =  K-1. 
It  is  clear  that  Q(t)  and  Q  Ct)  are  identical  in  value  except  at  the 
points  on  the  time  axis  for  which  Q((3)  =  K. 

We  shall  work  with  the  stochastic  process  [Q(t);-'=°  <  t  <  +"} 
and  shall  be  concerned  with  its  behavior  beyond  the  time  point  S'  , 
which  we  assume  is  known.   Hence,  without  loss  of  generality.  '^     could 
be  taken  as  zero. 

Define 

N^  =  inf  {k  >  0|Q(cr^)  =  K] , 

(2.1.4) 

N  =  inf  {k  >  N   J  Q(a  )  =  K} ,   n  >  2 , 
n  n-1  ^   k     •' 

(so  that  N   is  the  number  of  customers  who  arrive  up  to  and  including 

the  n-th  customer  to  balk),  and 


«1  '  "v 


»j  =  "j-Vi'  J"'' 


(2.1.5) 


(so  that  M.  (i  -^  2)  is  the  numbci  of  arrivals  between  the  (j-l)-st  and 
J     • 

j-th  balks  plus  the  j-th  person  to  balk). 
De  f  ine 


(2.1.6) 


J    ^i  3-1 


:ime 


Then  V   is  the  time  until  the  first  balk  and  V.  (j  ^  2)  is  the  t: 

between  the  (j-l)-st  and  j-th  balks. 

Of  primary  importance,  for  us,  is  the  value  of  £(V  ),  j  s  2. 

This    quantity   is   established    in   Section   2.3.      While   the   theorems    of 

Sections    2.2   and   2.U   are   proved  with  the   thought    of   building   toward 

a   solution   to  £(V.),    these  theorems    have   a   theoretical   and   practical 
J 

importance  that   goes   beyond   our  narrow  objective. 

2.2      An    Imbedded  Markov   Chain 

Before  we  define   the    imbedded  Markov   chain,   we  prove   two   lemmas 
The   first    lemma   simply  restates   a  well-known   result   about   negative 
exponentially  distributed   random  variables,   while  the   second   lemma 
establishes    the  non-Markovian   character   of   Q(t)  when   the   inter-arrival 
times   have   an   unspecified  distribution. 

Lemma   2.2.1 


Let   X  be   a   continuous,    non-negative   random  variable.     Then 

1 
I 

Pr    fx  >   X    +   y|x  >  x}    =   Pr    [X  >   y},      x,y   ^  0,  (2.2.1)        j 
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if  and  only  if 

Pr  [X  >  x}  =  e"^"",  \:.  >   0.  (2.2.2) 

Proof  of  Lemma  2.2-1 


If  (2.2.1)  holds,  we  have 

Pr  {X  >  X  +  y}  =  Pr  {X  >  x}  Pr  {X  >  y} 
and  therefore  (2.2.2)  is  true.   See,  for  example,  Parzen  (1962,  p.  121). 
If  (2.2.2)  holds,  we  have 

Pr  {X  >  X  +  y|x  >  x}  =  Pr  [X  >  X  +  y,X  >  x}/Pr  [x  >  x} 

=  Pr  fX  >  X  +  y}/Pr  [X  >  x] 

=    e-^y  =   Pr    rx>   y], 
thus    completing   the   proof. 

Lemma   2.2.2 

The  stochastic  process  {Q(t);-=°  <  t  <  +'"}  is  not,  in  general, 
a  Markov  process  . 

Proof  of  Lemma  2.2.2 

Without  loss  of  generality,  let  «7  =  0  and  Q(0)  =  0. 
Let   Y(t)  =   max  Q(T)    and   u  =  t-s .   We  have 

Pr  {Y(t)  =  0|q(t)  =  0,  0  ^  t  :S  s] 

=  Pr  fY(t)  =  0|u  >  s] 

=  Pr  {u^  >  t|u^  >  s] 

=  Pr  fu  >  u  +  sju^  >  s].  (2.2.3) 


n 


and 


Let  0  <  T   <  T   <  s,  and  define  the  events  A  and  B  by 
o    1 

A    =     {q(t)    =    0;     O^T<T,TSTfis} 

B   =    {q(t)    =    1;    t      s   t   <  t    ]    . 
o  1 


We  have 

Pr    (Y(t)   =   0|a,b] 

=   Pr[Y(t)    =   0|u^   =   T^,    u^  +w^    =   T^,    u^  +u,>s3 

=   Pr[u^  +U2>t|u^  =T^,    u^  +w^  =T^,      u^  +U2>s} 

=   Pr{u2>t-Tju2>s-T^} 

=    Prf  U,  >t-T    lu>s-T    } 
.    ■    1  o'    1  o-^ 

=   Pr[u    >u     +  (s  -T    )|u    >s  -T    }.  (2.2.4) 

1  o    '    1  0-' 

But    (2.2.3)   and    (2.2.4)   are   not   necessarily   equivalent. 

Yet,    if 

Pr[Q(t)  ^k|Q(T),    0  St  ^s]  =Pr{Q(t)  =k|Q(s)j 
for   all      t  -s,    then    (2.2.3)   and    (2.2.4)   would    have   to  be   identical. 
Therefore,    the   proof    is    complete. 

It   should  be   noted   here,    that,    if    the   u.    have   a  negative  exponential 
distribution,    then   Q(t)    is    a   Markov  process. 

Although      {Q(t);   -«><t<+'='}    is    a  non-Markovian   process    (in   general), 

there   exists    an    imbedded  Markov  chain   defined  by 

Q     =   Q(c^   ),      n   =   0,1,2,  .  ..,  (2.2.5) 

n  n 

regardless  of  the  distribution  of  the  u.. 

Figures  2.1  and  2.2  give  the  correspondence  between  Q(t)  and  Q  . 
Q  clearly  represents  the  number  of  persons  in  the  system  at  the  time 
the  n-th  customer  enters  the  system.   Valuable  information  about  Q(t) 
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can  be  obtained  from  a  knowledge  of  Q   as  will  be  shown  in  the  follow- 
ing theorems . 

Before  proceeding  further,  note  that  if  K  =  l,  then 
Pr[Q^  =  1}  =  1,  n  =  0,1,2,....   For  the  future  we  shall  therefore  hold 
K  ^  2. 

Theorem  2.2.1 

The  stochastic  process  {q  ;  n  =  0,1,2,...}  defined  by  (2.2.5) 
has  the  following  properties: 

(a)  Q      is    a   Markov   chain: 

n 

(b)  Q      is    time-homogeneous: 

n  ° 

(c)  The   class    [i,2,...,K]    of   states    on  which  Q      is    defined   is 
an  aperiodic,    positive   persistent    communicating   class;    and 

Cd)  The   one-step   transition   probability  matrix   P  is   given  by 
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Q(t) 
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Figure  2.1.   A  Typical  Fath  of  Q(t)  Cor  GI/M/1  with  Balking 
at  Queues  of  Length  4. 
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Figure  2.2.   Path  of  Q  Corresponding  to  Q(t)  in  Figure  2.1, 
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where 


and 


CO         j 

«.  =/  -^--e'^^  dF(t),   j  =0,1,2,...,  (2.2.6) 

J    o   J  - 


k.=l  -0^^-a^-  ...  -a,,  j=0,l,2,....  (2.2.7) 


Proof  of  Theorem  2.2.1,  Part  (a) 

Let  U(-)  be  the  unit  step  function  at  zero.   Let  X   ,  be  the 

n+1 

number  of  customers  who  complete  their  service  in  the  interval  (o     a        1. 

n   n+1 

Then 

Q  ^-1  =  Q  +  1  -  X  ^,  ,        if  Q  <  K, 
^n+1    ^n        n+1'  ^n 

Q  ^T  =  Q   +  1  -  X  ^,  -  1,     if  Q   =  K, 
^n+1    ^n        n+1  ^n 

so  that 

^n  +  1  ^  Q   -  X  ^,  -  U(Q  -K)  +  1,      Q  ^  K. 
n    n+1     ^n  n 

Since  the  distribution  on  service  times  is  negative  exponential, 

the  probability  law  on  X  , ,  conditional  on  the  history  0^,0, ,...,0   is 

n+1  -^  "^0  ^1     ^n 

a  function  only  of  Q  .   Hence,  we  see  easily  that  the  probability  law  on 

Q  ^,  conditional  on  the  history  Qr^,Q^  ,  •  •  •  ,Q      can  be  a  function  only  of 
n+1  ■'  ^0  ^1     ^n 

Q  ,  which  establishes  the  Markov  property  of  Q  . 

Proof  of  Theorem  2.2.1,  Parts  (b)  and  (d) 

Since  we  are  looking  at  Q(t)  at  successive  arrivals,  we  have 

l^Q^,  ^Q  +1.   Also,  of  course,  by  the  balking  aspect  of  the  problem 

Q  ^K.   Hence. 
n 

Pr{Q   ^,   =k|Q     =j}     =0,      for      k>i+l.  (2.2.8) 

n  +  1         '    n 
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Further, 

=  Pr{(k-1)  -X  ^-  +1  =k} 

=  Pr{Q,,,-k|Q^=K-l}.  (2.2.9) 

For  j  =1,2,...,K-1   and  k  =  2  ,  .  .  .  ,  jn  ,  let  N(t  )  be  a  Poisson 
process  with  inter -arrival  times  w^ jW^jW^ ,  .  .  . ,  then 

P^^Qnn=^''^n=^^=''"^^-Vl"'=^'^n=J^ 

=  Pr{X^,^=j-k.l|Q^=j} 

=  e,^^^^(Pr[N(u^,^)  ^  j  -  k.  1}) 
"   ,   /-,  .j-k+l 


=  Q;     . 
j-k  +  1 

Let  j  =  1,2,3,...,K-1   and  k  =  1,  then 

^"^^Vl  =  l|Qn=J^=''^*^^"Vl*'=''^n=^^ 

^^^^Vl^jI'^n^J^ 
=  eu„,,(Pr{w^  -•••*  Wj^Vl"*^ 


(2.2.10) 


=  /   (/  ^^'^   ^^   e'^^'/Cj-l)'.  dx)  dF(t) 


J  il    -     Z     e'^^  at)Vi'.)  dF(t) 
o       i=0 


(2.2.11) 
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Equations  (2.2.8)  through  (2.2.11)  are  independent  of  n  and 
therefore  Q   is  time-homogeneous.   Application  of  these  equations  for 
jjk  =  1,2,...K  gives  us  the  matrix  P. 

Proof  of  Theorem  2.2.1,  Part  (c) 

An  examination  of  the  one-step  transition  matrix  in  the  state- 
ment of  the  theorem  shows  that  each  state  communicates  with  all  others. 

Since,  for  example, 

^"^f^nn  =  kIq^  =  K]  >  0, 
state  K  is  aperiodic.   We  therefore  have  a  finite  irreducible  communicat- 
ing class  of  aperiodic  states  so  that  each  state  is  necessarily  positive 
persistent.   The  proof  of  Theorem  2.2.1  is  now  complete. 

We  shall  prove  a  lemma  that  applies  to  an  arbitrary  Markov  chain 
with  one-step  transition  matrix  P  given  by 


^ 

K 

K-l 

K-2 

•    •    • 

3 

2 

1 

K 

Pk 

-1 

1 

Pk 

-1,2 

Pk 

-1,3 

Pk-i,k- 

-2 

Pr-i.k- 

-1 

Pk-i,k 

K-1 

Pk 

-1, 

1 

Pk 

-1,2 

Pk 

-1,3 

Pk-i,k- 

-2 

Pk-i,k- 

-1 

Pk-i,k 

K-2 

0 

Pk 

-2,1 

Pk 

-2,2 

■     •     a 

Pk-2,K- 

-3 

Pk-2,K- 

-2 

Pk-2,K-1 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

3 

0 

0 

0 

•    •     • 

^3,2 

^3,3 

^3,4 

2 

0 

0 

0 



^2,1 

P2,2 

^2,3 

1 

0 

0 

0 



0 

Pl,l 

^1.2 

(2.2.12) 


in  which  p.  .  >  0  for  i  = 1 ,2  ,  .  .  .  ,K-1  ;  j  = 1 ,2 ,  .  .  . , i  +  1 
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If  a  Markov  chain  has  a  one-step  transition  matrix  of  the  form 
(2.2.12),  then  clearly  the  Markov  chain  is  aperiodic  and  positive 
persistent.   Hence,  there  exists  a  unique  long  run  distribution  equal 
to  the  stationary  distribution.   With  this  in  mind,  we  now  state  and 
prove  the  lemma. 

Lemma  2.2.3 

Let   P      of    (2-2.12)   be   the   one-step   transition   probability  matrix 

of   a   Markov   chain.      Then,    if    6      =    (0    , ...,9    )    is    the   unique   stationary 

"~       K       1 

distribution  for  the  Markov  chain. 


where 


and 


1/9=5-? 


(§K'^K-l'---'^2'*^  =  (1,1, ...,i) 


B  = 


''K-l.l 

Pk-1,2-1 

Pk-1,3 


^K-2,1 
Pk-2,2-^ 


K-3 , 1 


'k-1,K-2    Pk-2,K-3    Pk-3,K-U 


P3,2-^   P2,1 


K-1,K-1    ^K-2,K-2    ^K-3,K-3   '*•   ^3,3     ^2,2     ^1,1 


1   P. 
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Proof  of  Lemma  2.2.3 

By  the  definition  of  a  stationary  distribution,  9  is  the  unique 
solution  to 

e^'P*  =  _e'  (2.2.13) 

and 

e   +...+  e^  =  1  .  (2.2.14) 

Writing    out    the  equations    (2.2.13)    and    (2.2.14)   with   9      on 
the   left   hand   side,   we  get   the   following   system  of   K  linearly   independent 
equations  : 

^^-Pk-i,i^\  =  Pk-i,iVi 

-Pk-1,2®K     =    ^Pk-1,2-^^Vi   ^   Pk-2,i\-2 

-Pk-1,3®K     =   Pk-1,3Vi    "    ^Pk-2,2-^^V2    "   Pk-3,iV3 


-Pk-1,K-2®K=Pk-1,K-2Vi    "   Pk-2,K-3V2    "^    •••    *    ^Ps  ,  2"^  ^^3  "  P2  ,  1^2 

—  D  9=D  9  +D  9  +... 

'^K-1,K-1    K     PK-1,K-1    K-1        '^K-2,K-2    K-2 

+   D        9     +  (p        -1)0+0        9, 
^3,3   3      ^^2,2  2      '1,1    1 


-8=9  +    ,  .  .    +   9      -l- 

K        K-1  1 


(2.2.15) 


Let  A  be  the  (K  x  K-1)  matrix  of  coefficients  of  9    ,...,9 
in  (2.2.15),  then 
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A  = 


K-1,1 


Pk-1,2-^    Pk-2,1 


Pk-1,3     V2.2-^    Pk-3,1 


Pk-1,K-2    Pk-2,K-3    Pk:-3,K-4 


Pk-1,K-1    Pk-2,K-2    Pk-3,K-3 


P3,2-'   ^2,1 


P3,3     P2,2-^   Pi,1 


The  K-1  columns  of  A  form  a  set  of  linearly  independent  vectors 
of  dimension  K.   Hence,  there  exists  a  vector  £_  =  ^^K' ^K-1 '  ' '  ' '^1  "*  ^^^'^ 
that  §  is  orthogonal  to  each  column  of  A .   By  noting  the  last  column  of 
A,  we  must  have  §   /  0.   Therefore,  without  less  of  generality,  we  may 


take  1^  =  -1 .   That  is,  we  have 


§  A  =  0 


(2.2.16) 


with  0   the  null    vector. 


After  multiplying   the   n-th  equation   of    (2.2.15)  by  C      ari<i 
adding   them  up,   we    find 


®k'-^^"Pk-1,1'^^K"Pk-1,2^K-1  "Pk-1,3^K-2      ■" 


■Pk-1,K-2^3    -   Pk-1,K-1^2    *    ^^   =    ^ 


(2.2.17) 


But  by  (2.2.16),  if  we  take  the  scalar  product  of  £  with  the 
first  column  of  A,  we  have 


Pk-1,1^K  "  ^Pk-1,2-^^^K-1  "  Pk-1,3^K-2  ' 


"  Pk-1,K-1=2-1  =  0 


(2.2.18) 


Substituting    (2.2.18)    into    (2.2.17)    yields 


Since 


V^K- Vl^^l 
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1 ,1 ,  .  .  . ,  1 


and  5      =   -1,    (2.2.16)    implies    that 


K'^K-1 '  '  '  ' '^2  ^^   ~    '^1 J 1  s  •  •  •  J 1  )> 


thus  completing  the  proof. 

Corollary  2.2.1 

Let    (J,       be   the  mean   recurrence   time   of   state   K  for   a  Markov 
K.K. 

Ik- 
chain  with   one-step   transition   matrix   P      of    (2.2-12)    and   state   space 

{1,2,..,K}.      Then    pi      ,  |i      ,  |j,      ,  . .  . ,      are   finite  and   satisfy 


^^KK  =   ^ 


^/Pl,l' 


^i/Pk-i,i^ 


K-1  K-l 

^    \?,    PK-l,K-k.2    .^^    ^n 
k=2  j=k        -^ 


K=2, 


,    K  ^3. 


(2.2.19) 


Proof  of  Corollarv  2.2.1 


It    is   well    known   that    \x        =    l/9„,    9;^   the   stationary   probability 

associated  with  state  K,    and    \i        is    finite.      See,    for   example,  Parzen    (1962) 

K.K. 

By  Lemma  2.2.3,  if  K  =  2,    then  B  =  [p    ]  and  hence 

■'■>■'• 


n,2  -  i/e^  =  i/Pi^i  =  §2- 


(2.2.20) 
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If  K^S,  take  the  scalar  product  of  the  first  column  of  B  and 
(§,^j  •  •  •  >5o)  .  then  the  lemma  yields 

Pk-1,1^K  ^    ^^"Pk-1,2^^K-1  "  Pk-1,3^K-2  '  Pk-1,4-'K-3 

-  •••  -Pk-1,K-2^3  -Pk-1,K-1^2  ^  ^^     ^^'^'^^^ 

Subtracting  p^,  ,  ,§„  ,  from  both  sides  of  equation  (2.2.21), 
K.—  1  J  1  1^—  i 

we  get 

Pk-i,i^^k-^k-i^  =  ^^ -Pk-i,2-Pk-i,i^^k-i 

-Pk_1,3V2  -  •••  -  Pk-1,K-1^2  '    '■  ^2.2.22) 

Adding    and    subtracting    (I  -  Pj,_,    o  ~  ^F   I    l^^K-2    °"   ^^^   right 
hand   side   of    equation    (2.2.22)   we   obtain 

PK-l,l^^K-^tC-l^    =    ^1-Pk-1,2-?K-1,1^^^K-1  -^K-2^ 

*    ^^  -Pk-1,3-Pk-1,2-Pk-1,1^^K-2 

-Pk-1,.5k-3----    -Pk-.1,K-1?2^^-  ^'-'-''^ 

Continuing  in  this  manner  to  add  and  subtract  (coefficient  of 
§.)•§.    as  j  goes  from  K-2  to  3,  we  get 

Pk-1,1^^K-^K-1^  =    ^1  -Pk-1,2-Pk-1,1^^^K-1-^K-2^ 


*  ^^  -Pk-1,3-Pk-1,2-Pk-1, 


l'*^^K-2   ^K-3 


*  •'•*^^   -Pk-1,K-2  -Pk-I.K-3  -•••-PK-1,1^^^3  "^2^ 

*  ^1-Pk-1,K-1-----Pk-1,1^^2  *  ^• 


(2.2.24) 


n 


Note  that   I  -  E   p^  ^  ^  =   E    p^_^   ^ 

c=n+l      ' 


k=l  ^-^'^        k-- 
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Applying  this  result,  equation  (2.2.20),  and  \i..  .    =?.-§.    to 
(2.2.24),  we  have 

Pk-1,i\k=^  ^   f:^    ^n^._l.^,'K-l,^^l'  (2.2.25) 


Setting      i   =    (K-l)-k+2  in   equation    (2.2.25)    yield 

K-1  j 

Pk-1,1^KK=    1^    .1^    ^-j  .^2    PK-l,K-i.2 

K-1  K-1 


s 


(2.2.26) 


Dividing  both  sides    of    (2.2.26)   by  p  yields   equation 

K.—  i  ,  i 

(2.2.19),  thus  completing  the  proof. 

The  result  of  Corollary  2.2.1  can  be  applied  to  the  Markov  chain 
of  Theorem  2.2.1  to  obtain  the  mean  recurrence  time  of  state  K.   However, 
the  special  form  of  the  matrix  P  in  Theorem  2.2.1  lends  itself  to  a  more 
elegant  solution  for  the  mean  recurrence  time  than  that  given  by  the 
corollary.   Before  stating  this  solution  in  Theorem  2.2.2,  we  define 

oo 

9(9)  =  J  e'^"  dF(u),        6>0,  (2.2.27) 

o 

and 

00 

K(Z)  =  E  a.  Z^*,  Izl^l.  (2.2.28) 

j=0  J 

Also,  for  ease  in  writing,  if   h(Z)  is  any  function  of  Z,  denote  by 
C   h(Z)   the  coefficient  of  Z   in  the  expression  h(Z). 


23 


Theorem  2.2.2 

The  mean  recurrence  time  p.   for  the  state  K  of  the  Markov 

K.tv 

process    {q    ;    n   =   0,1,2,...}    of  Theorem  2.2.1    is    finite  and  satisfies 


^KK  "  ^^z'^^    l/[cpa(l  -Z))    -   Z]- 


(2.2.29) 


Proof    of   Theorem  2.2.2 


By  Theorem   2.2.1,    [i        is    finite   and 


^^  =  1/^' 


(2.2.30) 


where    6      is    the   stationary   probability  associated  with  state   K. 
The  P   of   Theorem   2.2.1(d)    is    P      of    (2.2.12)   with 


a 


i-l'      J"'' 


*i    i   "   1    k 


Hence,    Lemma    2.2.3    applies   with 


B   = 


a. 


(or^-1)  0^0 


a 


en 


K-3 


a 


K-2 


(a  _1)  a 

^   I   ^  0 


a 


K-4 


Of 


K-3 


a  ...      (a  -1 )         a 

K-5  (.«^    i^  u^o 


a 


K-4 


a 


(or^-l)  0.Q 
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In   Section   2.4,    it  ;>7ill    be   shown    that    for   a   matrix    of   the  special    form 
B   above,    the  solution   of    l/Q^   in   Lemma   2.2.3    is 


(K-2) 
UQ      =   §K-§K_i    =  C  1/(K(Z)-Z) 


But 


E     e"^^    (^Zt)Vj'. 
j=0 


^   1,      if        z|    ^   1, 


Therefore, 


(2.2.31) 


WJ  CD 

K(Z)    =     E      ZJ  J*      e~   ^    (At)Vj'.    dF(t) 
j=0  o 


=  /       T.      e'^^    (XZt)j'j!    dF(t) 
o    j=0 

=  f  e-'^^^-^)   dF(t) 
o 

=  cp(\(l  -z)). 
Hence,    (2.2.30),    (2.2.31),    and    (2.2.32)   give    the   desired   result. 


(2.2.32) 


2.3   Some  Properties  of  the  Time  Between  Balks 


The  theorems  in  this  section  refer  to  the  random  variables 
defined  by  (2.1.5)  and  (2.1.6).   These  theorems  are  not  only  useful  in 
discussion  of  the  queueing  problem,  but  also  provide  powerful  results 
for  the  inventory  problem  to  be  discussed  in  Chapters  5  and  6. 
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Theorem  2.3.1 


(a)  M  ,M  , M_,...,  are  mutually  independent  random  variables, 

(b)  M  ,M  ,M  ,  ...J  are  identically  distributed, 

(c)  e(M.)  =  p.^^,         j  ^2,  with  \x^^   given  by  (2.2.29). 

Proof  of  Theorem  2.3.1 

Let   B(i,j)  denote  the  event 

{q.  <K,  Q.^^<K,...,  Q-j_i<K,  Q.  =  K]. 

Let      k    ,k    ,k    ,  ...,   be   a   sequence  of   positive    integers    and   define 

n.    =   k,    +...+k..      Then    for   any     m-2, 
J  1  J 

PrfM^    =   k^,    M^    =   k^,...,    M^=   kj 

=   Pr{B(l,k^),    B(k^    +    l.n^),...,    B(n^_^    +    l,n^)|Q^} 

=  Pr{B(n  +l,n    )!Qit         =K}Pr{B(n  +l,n      .  ) !  Q^  =  K] 

m-1  m    '       m-1  m-2  m-1         "m-2 

...    Pr{B(k^  +l,n2)|Qki  =K}    Pr[B(l ,  k^  )  |  Q^} 

=   Pr[B(l,k^)|OQ  =K}    Pr{B(l,k^_^)|QQ=K] 

...    Pr{B(l,k2)|QQ  =K}    Pr    [B(l,k^)|QQ}    .  (2-3.1) 

The  second  equality  above  follows  by  the  Markov  property  of  Q  , 
and  the  last  equality  follows  by  time-homogeneity  of  Q  .   Hence, 

PrfM,  =k,  ,...,  M  =k  ]  =  PrfM,  =k,}  ...  Pr[M  =k  }. 
'^  1    1     '   m   m-"      "1    1-^        '■mm-' 

Therefore,  the  M.  are  independent,  and  by  examining  the  last  expression 

in  (2.3.1),  we  see  that  M.  (j  >2)  are  identically  distributed. 

J 
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Now,  for   j  "^  2 

Pr{M^  =  k}  =  Pr{Q^  <  K,  .  .  . ,  Q^^_^  <  K,  Q^^  =  k|  Q^  =  K] 

=  Pr[the  first  passage  from  states  K  to  K 

takes  k  stages} . 

Hence, 

£(M.)  =  mean  recurrence  time  of  state  K 
J 

Applying  Theorem  2.2-2,  we  complete  the  proof. 

Theorem  2.3.2 

(a)  V  ,V  ,V  ,.  ..,  are  mutually  independent  random  variables, 

(b)  V  ,V  ,V  ,  ...,  are  identically  distributed, 
Cc)  e(V.)  =  e(M.)  3(u, ),   j  ^  1 

=  '^^^   e(u^),     j  >  2 
where  \x        is  given  by  (2.2.29)  and  u,  is  given  by  (2.1.2) 

Proof  of  Theorem  2.3.2 


Since, 

parts  (a)  and  (b)  follow  directly  from  Theorem  2.3.1  (a)  and  (b),  rhe 

assumed  independence  of  the  u,  ,  and  the  independence  of  u    and  0  • 

k'  '^  n+1     ^n 

Assume  that   Q=i,   (l^i^K).   Let 
* 
n    n    o 


so  that 


a  =u,  +...+U,    n-1. 
n    1  n 
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7C 

Now    (J      -   n£(u, ))    is    a  martingale   and 
n  1 

e(a     -   nfiCu,  ))   ■-   0,    for   all   n. 
n  1 

The   event      [m,    >   k]    e   B^,   where   B^.    is    the   cj_field 

of   events   generated  by      [°, j--->®,}    and   {w    , ...,w        }. 

Clearly,    B^^  ^  B^^+i  • 

Hence,  M  is  an  optional  stopping  rule  and  has  no  effect  on  the 
martingale  property.   See,  for  example.  Feller  (1966,  p.  214). 
Therefore, 

ecv^  -  M^  e(u^))  =  £(0?!^  -  M^  e(u^)) 

=   0. 

Now  let    i   =   K   in   the   above   solution   so  that   M     has   the   same 

distribution   as   M.    (j   ^  2).      Then 
J 

ecv.  -  M.ecu, ))  =  s(v,  -  M^ecn  ))  =  o,    j  ^  2, 
J       J      1  111 

and  part  (c)  follows  immediately  from  Theorem  2.3.1(c),  thus  completing 
the  proof. 
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2.4  The  Inverse  of  a  Special  Triangular  Matrix 

Let   P„,  P  ,  3  ,  ...,  be  a  sequence  of  numbers  such  that  P_  7^  0. 
If  B  Is  a  (n+1)  X  (n+1)  matrix  of  the  form 


B 


3o    P.    P. 


K  K-l      K-2      ■■■      h  ^0 


(2.U.1) 


then  B        is    obviously   of   the   form 


-1 


(0) 


g(l)  p(0) 


p(2)  p(l) 


,(0) 


p(n)  p(n-l)      oCn-2)  .(1)  p(0) 


(2.i+.2) 


We  show  the  following: 


Theorem  2  .ii.l 


,(k) 


1/00  > 
/ 

j  =  l 


k  =  0, 


k  s  1, 


(2.4.3) 
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with 


A(j:k)    =  H  ...        -Z  3^^    0^2    •••    Pii 

i,  +....+    i  .   =   k  ■' 

1  J 

(i^  ^  l,...,ij   ^  1) 


If,    in    addition,        E      P.    converges. 


P^"^    =  l^Z        1/B(Z),         k   ^  0  (2.4.4)  { 


<x> 

with     B(Z)    =        S      P.Z^ 

J 


j=o 


Proof   of  Theorem  2.4.1 

It    is    clear   that      P  =    1/3^,.      To  show    (2.4.3)    true   for 

k  S   1,    we  need   simply  verify   that 

E     3^*^^   3,   k   =   0.  ^  =   1,2, ...,n. 

k=0  "'"'' 

Now, 

m        ,  m        (k) 

E     ^^""^  3     ,    =  B  /B_  +    E     3         3     ^ 
,    rt  1°-'^  m     0        ,     ,  m-k 

k=0  k=l 

m  k  . 

=   3   /3^   +     E      3      ,      E      (-l)J   A(j:k)/3,^;    " 
m      0        ,     ,      m-k    .    ,  ■"  0 

k=l  j=l 

m  .       ^  J.1      m 


■i     i+1    "' 

=   3    /3n  *    ^    (-1)    /P;^  2      3      ^   A(j:k)-  (2.4.5) 

m      0       .    ,  0        ,      .      m-k 

j=l  k=j 
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The    coefficient    of    1/3      in    the    last   expression    is    3    -AClim)  =0, 
and   for      j    =    l,2,...,m-l    the   coefficient   of 

■j  +  l  •    (-m-l  ^ 

1/r        =    (-l)J   -^    E      3      .     A(j:k)    -   A(j+l:ra)^ 
0  Iw,      .      tu-k        -^  J 


=    (-1)^"    {' 


m-1 

E       E 


C         ...       E  3i     3,     ...   3i 

i,    +    ...    +   i.   =  k  J 

1  1 


m-k 


-  E 


E 


h  ^  '■'  ^  S-n  =  "^ 


'ii  •-  PijJ  =  °' 


Hence,  (2.iK5)  is  zero  and,  therefore,  (2.4.3)  is  true. 


For  n  '^  k  -  1, 


(k) 


A(j:k)  =  C    (3,Z  +  ?X    -^  •••  "3  z")-* 


Hence,  from  (2.4.3) 


P^'^^  ^C^'^  E  [(-l)V3.r'](3.z  -  -..  -PZ-^)^' 


j=l 


(-1/3, )C^ 


(3,z  +  ...  +  3  z") 

1  n 


1  -  [(3,z  +  ...  +  3  z")/-3J^ 

1  n      0 


\  -1 


1  + 


3^z  + 


+  3  z' 

n 


The  term  in  brackets  in  the  numerator  of  the  last  expression 
above  contributes  nothing  to  the  coefficient  of  Z   and  hence  can  be 
dropped . 
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Therefore, 


(k)  <^^      0  Z  +  ...  .  0  Z 


0   z   p^^.p^2^_.+3^zn 

But,  by  adding  and  subtracting  3   in  the  numerator,  we  have,  for  n-k^l, 

(k)  (^)  /         ^n      \ 

r^   =  (-1/P^)  C    1 


°   z       P^  -....-  0  z" 

'0  n   ' 

(k)  n 

=  C     1/(0^  ^    ...    +  P  Z  )  .  (2.4.6) 

Z       0  n 

The  last  equality  follows  since  Z   =  1   and  we  have  taken  k  '^  1 . 
But  (2.4.6)  holds  for  all   n  -  k,  hence 

(k)     ^^^ 
3^*^^  =  C     1/S(Z),     k  S  1. 

I 

That  (2.4.4)  holds  for   k  =  0   can  be  seen  by 

(0)  (0) 

C     1/B(Z)  =  C     l/[l-(+l-B(Z))] 
Z  z 

1 

(0)  "  .  1 

=  C,    Ed-  B<Z))-' 

Z      --A 

j=0  I 

=  E   (1  -  0  )^'  =  1/0Q  =  r°^  . 

j  =  0  i 

The  proof  is  now  complete.       "  I 

To  verify  equation  (2.2.31),  it  is  noted  that  the  matrix  B  above    | 

1 
equation  (2.2.31)  is  of  the  form  (2.4.1)  with  i 

r\,  k  /  1,  ' 

°k  ^  La  -1,    k  =  1,  i 

1  1 

( 

I 

and,  therefore,  B(Z)  =  K(Z)  -  Z. 
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Applying  Theorem  2.U.1   with      n   =   K-2    to   obtain   the   solution 
of    our   particular   B      ,    we   have   from  Lemma   2.2.3 


^K-    Vl    =    ^I'l'- 


,1)    B 


-1  r- 


+  1 
-1 
0 


3 


(K-2) 


(K-2) 
C  1/(K(Z)    -    Z) 

Z 


CHAPTER   3 


TllE    QUEUE   GlAl/"  WITH  BALKING 
AT    QUEUES    OF    LENGTH   K-1 


3 . 1      The   Basic   System 


Consider   a   queueing   system   in  which   customers    arrive   in   the 
system  at   times,    •  •  •  ,^_2'''-l '"'o'^'l '^2  '  '  '  * '    ^''''^  ^^''^   ^'^^   inter-arrival 
t  imes 

u.   =  a.   -  c.  j  >  1,  (3.1.1) 

J  3  3-1 

are  mutually  independent.   The  distribution  function  of  u  will  be 

denoted  by 

Pr{u.  ^  u}  =  F(u),     u  -  0,      j  ^  1.         (3.1.2) 

We  assume  there  is  a  sufficient  nuraber  of  servers  so  that,  if 
a  person  joins  the  queue,  his  service  commences  immediately.   The  queue 
length  at  any  time  t  is  the  nuraber  of  persons  being  served  at  time  t 
(no  one  has  to  wait  for  service)  or,  equivalently,  the  number  of  busy 
servers  at  time  t.   Since  a  customer  balks  at  a  queue  of  length  K-1, 
there  are  never  more  than  K-1  servers  busy  at  any  one  time.   Hence,  the 
queues  GI/lV"  and  GI/M/s ,  for  s  ^  K-1,  both  with  balking  at  queues  of 
length  K-1,  are  identical. 

We  also  have  the  apparent  absurdity  that  a  person  would  balk 
from  a  system  with  an  infinite  number  of  servers-   It  would  be  better 
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3ii 


in  this  case  to  assert  that  the  customer,  who  arrives  to  find  K-1 

servers  busy,  is  rejected  by  the  system. 

The  successive  service  times  for  customers  who  join  the  queue 

are  denoted  by  v;  ,v;  ,w  ,...,  and  are  assumed  to  be  mutually  independent 

random  variables.   Any  w.  is  also  assumed  to  be  independent  of  the 

arrival  times.   The  distribution  function  of  w .  is  assumed  to  be 

J 

Pr[w.  ^  w}  =  1  -  e~  ",     w  s  0,   j  ^^  1 .         (3.1.3) 

As  before,  we  let   {Q(t);  -°"  <  t  <  +  °°}   be  the  stochastic 
process  such  that  Q(t)  represents  the  number  of  people  in  the  system 
at  time  t.   The  num.ber  of  people  that  can  be  in  the  system  at  any  one 
time  is  restricted  to  K  by  requiring  Q(C7  +0)  =  K-1  whenever  Q(cr)  =  K. 
See  Section  2.1  for  a  more  thorough  discussion  of  Q(t). 

V7e  are  interested  in  the  development  of  Q(l)  beyond  the  time 
point  o    .      Without  loss  of  generality,  cr„  could  be  taken  to  be  zero. 

Once  again  we  are  interested  in  'the  random  variables 

N^  =  inf  {k  >  0|Q(a^)  =  K} , 

N  =  inf  {k  >  N   ,  lQ(a,  )  =  K] ,     n  ^  2,         (3.1.4) 
n  n-1 '    k     ' 

M.=N.-N.,,      j-2,  (3.1.5) 

J     J     J-1 


and 


Vj  =  ^Nj  -  ^Nj_i'      J  "^   2.  (3.1.6) 
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A  complete  description  of  these  random  variables  is  given  in 
Section  2.1. 

Since  the  service  times  are  negative  exponentially  distributed, 
we  Cind  that  many  of  the  results  derived  in  Chapter  2  will  apply  to  the 
queue  GI/M/^  with  balking  at  queues  of  length  K-1  without  any  change  in 
the  proofs . 

As  before,  we  follow  a  systematic  approach  to  find  the  solution 

of  e(v.). 

3 

3.2   An  Imbedded  Markov  Chain 

Lemma   2.2.2   applies    to   the   stochastic   process    fQ(t);  -ra<t<+°='} 
defined   in  Section   3.1    and   Q(t)    is,    therefore,    in   general,    a  non-Markovian 
process.      However,    there   exists    an    imbedded  Markov  chain   defined   by 

Q     =   Q(:t   ),  n   =   0,1,2, (3.2.1) 

Figures  3.1  and  3.2  give  the  relation  between  Q(t)  and  Q  . 

0   clearly  represents  the  number  of  persons  in  the  system  at  the  instant 
"n 

the  n-th  customer  arrives.   Once  again  we  shall  restrict  our  attention 

to  the  cases  KS2,  for  when  K  =  l,  Pr[Q  =l}  =  l,   n  =  0,l,2, 

Information  obtained  from  the  stochastic  process 
[q  ;  n  =  0,1,2,...]  will  provide  sufficient  information  about 
[Q(t);  -«><t  <+=='}  for  our  purposes- 

I 

I 

Theorem  3.2.1  ' 

<  I 

The  stochastic  process  fQ  ;  n  =  0,1,2,...}  defined  by  (3.2.1)       ■ 

n  1 


has  the  following  properties: 
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Q(t) 
A 


o: 


N, 


05    oo+vv,    02 


02+vv3Cr3+W4crQ 


04+W505+vvg 


Figure  3.1.   A  Typical  Path  of  Q(t)  for  GlAl/°°  with  Balking 
at  Queues  of  Length  4. 
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Figure  3.2.   Path  of  Q  Corresponding  to  Q(t)  in  Figure  3.1. 
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(a)  Q      is    a   Markov   chain: 

n 

(b)  0      is   t inie- homogeneous  ; 

n 

(c)  The   class      fl,2,...,K]    of   states    on  which  Q      is   defined 
is    an   aperiodic,    positive   persistent   communicating   class; 
and 

(d)  The   one-step   transition   probability  matrix   P   is   given  by 


K 


K-1 


K 

K-1 
K-2 


b(K-l,0)      b(K-l,l) 

b(K-l,0)      b(K-l,l) 

0  b(K-2,0) 


0 
0 
0 


0 
0 
0 


b(K-l,K-3)  b(K-l,K-2)  b(K-l,K-l) 
b(K-l,K-3)  b(K-l,K-2)  b(K-l,K-l) 
b(K-2,K-4)      b(K-2,K-3)      b(K-2,K-2) 


b(3,l) 
b(2,0) 
0 


b(3,2) 
b(2,l) 
b(l,0) 


b(3,3) 
b(2,2) 
b(l,l) 


where 


b(n,k)=  ;      (U)    (1    -   e-'")^    (e-^'^)"-'^  dF(u). 


(3.2.2) 


Proof  of  Theorem  3.2-1 

The  proofs  of  parts  (a)  and  (c)  are  identical  to  those  given  for 

Theorem  2.2.1  (a)  and  (c).  We  need  only  show  parts  (b)  and  (d). 

Let  U(-)  be  the  unit  step  function  at  zero.   Let  X   ,  be  the 

n  +  1 

number  of  customers  who  complete  their  service  in  (c   o    ].   Then 

n   n+1 
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so   that 

Q^,.    =   Q      +    1    -   X   ^^    -   U(Q   -K),    Q     s   K. 
n+1         ^n  n+1  n  n 

Since  we   are   looking   at   Q(t)    at   successive   arrival   titaes,   we   have 

n  +  1         ^n 
By   the  balking   aspect    of    the   probleei,      Q     ^    K. 
Hence, 

Pr{Q^^^    =   k|Q^   =   j3    =  0,      for   k  >   j    +   1.  (3.2.3) 

Further, 

Pr{Q  ^T    =   k[Q     =  K]    =   Pr'K  -  X      ,    -1    +   1    =   kJQ     =   K] 
■■^n  +  l  '  ^a  -'  -  n^l  '  ^n  •' 

=   Pr{(K-l)    -  X   ^,    +   1    =   klo     =   K-l] 
n  +  1  ^n  -' 

=   Pr{Q      .    =   k|Q      =   K-l].  (3.2.4) 

u+1  n 

For      1  ^    j  ^   K-l      and     k  ^    j+1,   we   have 

^'- Vl    =   '^I'^n    =    J^    =   ^^^J    -  \  +  l    *    1    =    *^'^n    =    J^ 

=   Pr{exactly   j    +    1    -    k   persons    out 
of   j    complete   their   service    in 

n'    n  +  1-'-' 

=  S    (Pr{exactly  j+1  -  k  independent  events 
"n+1 

[w  ^  u   }  occur  out  of  j  possibilities}) 

=  b(j,  j  +  1  -  k).  (3.2.5) 
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Equations  (3.2.3)  through  (3.2.5)  are  independent  of  n  and  hence 

part  (b)  follows.   Application  of  these  equations  when  j,k  =  1,2,...,K 

gives  the  matrix  P,  thus  completing  the  proof. 

Let  \i       be  the  mean  recurrence  time  of  the  state  K  for  the  imbed- 
KK 

ded  Markov  chain  of  Theorem  3.2.1.   If  we  let  p   ,  =  b(n,k  -  1),  we 

n ,  K 

ic 

have  that  the  matrix  P  of  Corollary  2.2.1  and  the  matrix  P  of  Theorem 
3.2.1  are  identical.   Hence,  \i,      ,\i      ,^      ,  .  .  .  ,    satisfy 


'^1A>(1,0), 


K  =  2, 


^KK 


(3.2.6) 


l/b(K-l,0) 


K-1  K-1 

1  +  E  b(K-l,K-k+l)  E   |j,.  . 
k=2  j=k   ^^_ 


,  K  >  3 


The  matrix  P  of  Theorem  3.2.1  and  equation  (3.2.6)  both  contain 
the  quantity  b(n,k)  defined  by  equation  (3.2.2).   However,  this  integral 
expression  is  not  a  form  that  lends  itself  to  easy  evaluation.   Fortu- 
nately, b(n,k)  can  be  expressed  as  a  function  of  the  parameter  A.  of 
(3.1-3)  and  the  Laplace  transform  of  (3.1.2)  in  the  following  manner. 
Let 


then 


-Gu 


cpO)  =  J  e  '^  dF(u),    9^0, 


(3.2.7) 


o 

00 


\uk  ,  -\u.n-k 


b(n,k)  =  ;  (;;)  d  -  e-^^*^  (e-"^)"-*^  dF(u) 
o 

00     ^ 

=  (,  )     1.  (.)  (-e    )-^  (e    )    dF(u) 
•^  "^o  j=0  J 

=  O      Z      ('?)(-l)J  f  ^-^^-^*V^^   dF(u) 
^  j=0   J       o 


(")   Z   (^)  (-1)^'  •^(.\(n-k  +  j)) 


(3.2.8) 
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3.3   Some  Properties  of  the  Time  Between  Balks 

The  following  theorems  refer  to  the  random  variables  defined 
by  (3.1.5)  and  (3.1.6).   The  proofs  of  these  theorems  are  identical  to 
those  given  for  Theorems  2-3.1  and  2.3.2.   Hence,  only  the  statements 
of  the  theorems  will  be  given. 

Theorem  3.3.1 

(a)  M  ,M  ,M  ,  ...,  are  mutually  independent  random  variables, 

(b)  M  ,M  ,M  , ...,  are  identically  distributed, 

(c)  eCM.)    =    [^^^,         j  ^  2 
with  (i   given  by  (3.2.6). 

Theorem  3 .3^2 

(a)  V  ,V  ,V  ,  ...,  are  mutually  independent  random;  variables, 

(b)  V  ,V  , V  ,  ...,  are  identically  distributed, 


(c)  e(v.)  =  e(M.)  e(u  ),       j  s  i 

J       J      1       -^ 

=  ^.^e(u^),  j^2 


with   jj,        given   by    (3.2.6)    anci   u.,    defined  by    (3.1.2). 


CHAPTER  4 


THE  QUEUE  GI/D/1  WITH  BALKING 
AT  QUEUES  OF  LENGTH  K-1 


4.1   The  Basic  System 

Consider  a  queueing  system  in  which  customers  arrive  in  the 

system  at   times,    •  •  •  .=^_2 ''^.l ''^0 '^1 '^2  '  '  '  ' '    ^"^^  ^^^^    ^^^    inter-arrival 
times 

u.   =  a.    -  a._^,  j   s  1,  (4.1.1) 

are  mutually  independent.   The  distribution  function  of  u  will  be 
denoted  by 

Pr{u.  s  u]  =  F(u),    u  2.  0,   j  ^  1.  (4.1.2) 

One  server  is  available  to  handle  the  needs  of  the  customers. 
This  server  dispenses  his  service  on  a  strict  "first  come,  first 
served"  basis.   The  service  time  of  any  customer  who  joins  the  queue 
is  assumed  to  be  a  constant  value  b. 

Let   rQ(t);  -°°  <  t<+°°}  be  the  stochastic  process  such  that 
Q(t)  represents  the  number  of  people  in  the  system  at  time  t.   The 
number  of  people  that  can  be  in  the  system  at  any  one  time  is 
restricted  to  K  by  requiring   Q(a+0)  =  K-1  whenever  Qi^)    =  K. 
A  more  thorough  discussion  of  Q(t)  and  its  relation  to  the  queue 
lenc^th  is  found  in  Section  2.1.   As  in  the  previous  two  chapters, 


Ul 
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we  are  interested  in  the  development  of   Q(t)  beyond  the  t  iaie  point 
CTq.   We  could,  therefore,  take  <^q  =  0  without  loss  of  generality. 
Define 

N^  =  inf  [k  >  0|Q(a^)  =  k] , 

N^  =  inf  [k  >  N^_jQ(a^)  =  K},     n  ^  2,  (4.1-3) 

Mj  =  N^  -  N^._^,     j  ^  2,  (4.1.4) 

and 

V-j  =  ^Nj  -  °^Nj_i'   :  ^  2.  (4.1.5) 

A  complete  description  of  these  randcm  variables  is  given  in 
Section  2.1. 

Our  ultimate  objective  is  to  find  an  expression  for  S(v.). 

Unfortunately,  we  are  only  able  to  obtain  an  exact  expression  for 

£(V_.)  in  terms  of  quantities  that  are  difficult  (if  not  impossible) 
J 

to  obtain.   The  results  that  we  do  establish  are  based  on  the  concept 

of  the  waiting  time  in  the  system.   The  definition  of  the  waiting  time 

and  our  motivation  for  its  use  in  the  search  for  a  solution  to  £(V.) 

J 

now  follow. 

Let  W(t)   be   the   amount   of   time    it  would   take   our   server  to 
finish  serving   all    of    the   customers    present    in   the    queue   at    time  t. 
W(t)    is    then    called   the  waiting    time    in    the   system,  at    time   t.       If   <J 
is    the   time    of    an    arrival    into   the   system,    then 
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Q(,a)   <   K      implies   W(o)  =  W(o-O)  +  b 

and 

Q(c)  =  K   implies   W(a)  =  W(o-O). 
The  latter  condition  reflects  the  fact  that  a  customer  arriving  in  the 
system  to  find  K-1  persons  already  in  the  queue,  leaves  without  waiting 

to  be  served. 

By  the  balking  aspect  of  the  problem,  at  most  K-1  persons  may 
be  in  the  queue  at  any  particular  time  t-   Since  the  service  time  is 
a  constant,  b,  we  have  0  ^  W(t)  ^  (K-l)b. 

Again  let  ^   represent  the  time  of  an  arrival  into  the  system. 

Clearly, 

Q(a)   =   1      if   and   only   if     W(a-.C)    =   0. 
Further,    if   Q(J)    =    j      (j    =   2,3,...,K)   we  iiust    have   Q(a-O)    =   j-1  . 
Since  the  service   time   for   any   one   customer    is   b ,    a   constant, 

(j-2)b  <  W(a-O)   ^    (j-l)b. 
That    is ,    for   j    =   2,3,  .  .  .  ,K 

Q(a)   =    j      if   and   only   if      (j-2)  <  W(a-O)   ^    (j-l)b. 

Hence,  complete  knowledge  of  the  stochastic  process  defined  by 

Q  =  Q(a  ),     n  =  0,1,2,  ..  ., 
^n   ^  n 

can  be  obtained  from  a  knowledge  of  the  probability  law  of  the 
stochastic  process  defined  by 

W  =  W(c:  -0),    n  =  0,1,2, (4.1.6) 

n      n 

Figures  4.1  and  4.2  give  typical  realizations  of  Q(t)  and  W^. 
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Figure  4.1.   A  Typical  Path  of  Q(t)  for  GI/D/1  with  Balking 
at  Queues  of  Length  4. 
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Figure  4.2.   Path  of  W  Corresponding  to  Q(t)  in  Figure  4.1, 
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The  random  variables  defined  by  (4.1.3)  can  now  be  expressed 

in  the  equivalent  form 

N,  =  inf  [k  >  Olw,  >  (K-2)b}, 
1  '  k 

N   =  inf  [k  >  N   Jw  >  (K-2)bi,    n  ^  2.  (U.1.7) 

n  n-1 '  k 

It  may  be  further  shown,  by  considering  a  slight  modification 

of  the  proof  of  Lemma  2.2.2,  that  both  Q(t)  and  W(t)  are  non-Markovian 

processes.   Since  we  now  have  constant  rather  than  negative  exponential 

service  times,  it  is  also  true  that  Q   is  non-Markovian.   However,  it 

n 

will   be   shov.Ti    in  the  next   section   that  W      is    a   Markov  process.      Because 

n 

of  the  Markov  nature  of  W  and  the  equivalence  of  (if. 1.3)  and  (4.1.7), 

n  ^ 

we  are  led  to  consider  the  stochastic  process  [w  ;  n  =  0,1,2,...]  in 

n 

our  search  for  an  expression  for  £(V.). 

J 

As  always,  we  shall  ignore  the  trivial  case  when  K  =  1. 

k.2      The  Waiting  Time  in  the  System 

Let   [w  ;  n  =  0,1,2,...}  be  the  stochastic  process  defined  bv 
n  • 

(4.1.6)  so  that  W   is  the  waiting  time  in  the  system  immediately  pre- 
ceding the  n-th  arrival  into  the  system.   Then  it  is  clear  that 
W  s  (K-2)b,  i.e.,  Q  <  K,  implies 

r  0,  ifW+b^u,, 

W    =  {  "        "^1 

"^1    ^  W  +  b  -  u   .      if  W   +  b  >  u   , 
n        n+1,        n        n+1, 

and  W  >  (K-2)b,  i.e.,  Q  =  K,  implies 


r  0,  if  W  s  u  ^^, 

J  n    n  +  1 

W    =1 

n+1     W  -  u  ^^ ,        if  W  >  u   ,  . 

n  n+1'            n    n+1 
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If  !](•)  is  the  unit  step  function  at  zero,  we  can  rewrite  the 
above  expressions  in  the  form 

W   ,  =  max  [O,  W   -  u   ,  +  b  U((K-2)b  -  W  )},   n  ^  0.        (4.2.1) 
n+1  n    n+1  n  -' 

We  now  note  the  relation  between  (4.2.1)  and  the  analogous 

expression  for  the  waiting  time  just  prior  to  an  arrival  in  the  queue 

GI/D/1  (no  balking).   If  we  let   {w  ;  n  =  0, 1 ,2 ,  .  . . }   be  the  stochastic 

process  that  represents  the  latter  waiting  time,  we  have  the  well-known 

result 

W  ^,  =  max  {O,  W   -  u   ,  +  b},       n  ^  0.        (4.2.2) 
n+1  n    n+1 

See,  for  example,  Prabhu  (1965b). 

The  difference  between  W  and  W   is  that,  for  the  former, 

n      n        ' 

a  person  who  enters  the  system  and  faces  a  queue  of  length  K-1  balks 

and  adds  no  service  time  to  the  syste?j. 

We  now  formally  state  and  prove  some  basic  properties  of  the 

stochastic  process   [w  ;  n  =  0,1,2,...]. 

n 

Theorem  4.2.1 

The  stochastic  process      [w    ;   n   =   0,1,2,...}    is    a   time-homogeneous 
Markov  process    concentrated   on   the   continuous    state   space   [0,    (K-l)b] 
with  one-step   transition   distribution 

r   1    -   F(y-x-O),  y  >    (K-2)b, 

^^K+1  ^  ^'^n   =   y]    =  1  (4.2.3) 

1    -   F(y+b-x-0),      y  ^    (K-2)b. 

Note   that    the    interval    on  which    (4.2.3)    is    concentrated    is    actually   a 
sub-interval    of      [O,    (K-l)b],    this    sub-interval   being   a   function   of   y. 
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Proof   of   Theorem  U.2.1 

Let   m^,m^,m3,...,    be   a   sequence   of    integers    such   that 

m     <  m,   <    ...   <  tn     <  n.      Then 

Pr[w^,^  s  xjw^  =   y,   W^^^  =  y^^,...,W„,^   =  y^} 

.   Pr[maK    [y   -   u^^^   ^  bU( (K-2 )b-y),    0]   ^   x} 
=  Pr{w^,i  ^  x|w^  =   y}. 

Hence  W      is   Markovian.      Nov;, 
n 

^  Pr[0  <  W^^^  «  x|w^  =  y} 

=   Prfy  -   u     ,    +  bU((K-2)b-y)  ^   O} 
'■•'  n+1 

+  PrfO  <  V   -   u      ,+  bU((K-2)b-y)  ^   x} 
*•  ■'  n+1 


=   Pri"u  ^  y   +  bU((K-2)b-y)   -   x} 

n  +  l 

=   1    -   F(y   +   bU((K-2)b    -   y)    -   X    -   0),  (4.2.4) 


which   is    independent    of   n/and   therefore  W^    is    time-homogeneous. 
Equation    (U.2.4)    is    the  same  as    (4.2.3),    thus    completing   the  proof 
To  simplify   the  notation,   we  write 

P    (y,    x)    =   Pr[w^  ^   xIWq   =    y] ,         n  ^   1, 


(4.2.5) 


and 


P(y,    x)    =   P,^(y,    x). 


(4.2.6) 
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Theorem  4.2.2 

The  n-ste.p  transition  distribution  functions  defined  by  (4.2.5) 
are  concentrated  on  the  continuous  state  space  [O,  (K-l)b]  (or  a  sub- 
interval  of  it)  and  satisfy 


P    (z,x)  =      J  P^^^'y^  d  F(y-x-O) 

"  ^        max(x,(K-2)b)   "       ^ 

(K-2)b 
+       I        P  (z,y)  d  F(y+b-x-0) 
max(0-,x-b)  ' 

-  P  (2,(K-2)b)  [F((K-l)b-x-0) 
n 


-  F((K-2)b-x-0)].  (4.2.7) 


Proof  of  Theorem  4.2.2 


By  the   Chapman-Kolmogorov  equations. 

(K-l)b 

P^.(2,x)=r  P(y,x)    P    (2,dy).  (4.2.8) 

n+1  ♦'  ■'  n 

Integrating  by  parts,  (4.2.8)  becomes 

y  =  (K-l)b 
P    (z,x)  =  [P(y,x)  P^(z,y)] 

y  =  0- 

(K-l)b 
-  /       ^n^^'y^  P(dy,x) 

(K-l)b 
=  P((K-l)b,x)  -  /      P  (z,y)  P(dy,x). 


(4.2.9) 
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By  Theorem  U.2.1,  we  have 


r  0,  y  ^  X, 

PCdy.x)  =  I  (K-2)b  <  y  ^  (K-l)b, 


-d  F(y-x-O),    y  >  X, 

0,  y  ^  x-b, 

P(dy,x)  =  I  0  ^  y  <  (K-2)b, 

-d  F(y+b-x-0),   y  >  x-b, 

P(dy,x)  =  F((K-l)b-x-0)  -  F((K-2)b-x-0),    y  =  (K-2)b, 
so  that  (4.2.9)  becomes 


?   ,(z,x)  =  1  -  F((K-l)b-x-0) 
n+1 


(K-l)b 
♦      J        P  (z,y)d  F(y-x-O) 
■  maxCx, (K-2)b)   "      ^ 

(K-2)b 
+       I        ?  (2,y)  d  F(y+b-x-0) 
max(0-,x-b; 

-  P  (z,(K-2)b)[F((K-l)b-x-0) 
n 

-  F((K-2)b-x-0) j  .  (4.2.10) 

But   P  (z.y)  =  1,   for  y>  (K-l)b.   Hence  (4.2.10)  becomes 
n 

(4.2.7),  thus  completing  the  proof. 

Various  attempts  have  been  made  to  establish  the  stationary 

distribution  of  W  ,  all  without  success.   Since  the  stochastic  kernal 
n 

P(y,x)   does  not  satisfy  the  regularity  conditions  stated  in  Feller 
(1966,  Sec.  VIII,  7),  we  are  not  even  sure  if  W  possesses  a  stationary 
distribution . 

As  will  be  seen  in  the  next  section,  the  most  important  result 
of  this  section  is  the  Markov  property  of  W  established  in  Theorem  4.2.1 
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4.3   Some  Properties  of  the  Time  Between  Balks 

We  are  now  ready  to  obtain  solutions  for  the  expected  values  of 

the  random  variables  M.  and  V.  defined  by  (4.1.4)  and  (4-1.5),  respec- 

J       J 

tively.   In  the  previous  chapters  exact  results  were  derived  for  these 

expectations,  but  in  this  chapter  we  must  be  content  to  utilize  unsolved 

expressions  for  the  expectations  of  interest.   In  order  to  reach  our 

objectives,  we  make  use  of  the  properties  of  the  following  quantities. 

Let 

S   =  nb  -  u,  -  .  .  .  -  u  ,    n  s  1 , 
n         1  n 

and,  for  0  ^  y  ^  (K-1)d,   y  a  real  number,  let 

V  ^  (K-2)b, 


y  -  b,     y  >  (K-2)b. 


Define 


N(y)  =  inf  fn  >  o|w  >  (K-2)b;  W^  =  y}  (4.3.1) 

(so  that  N(y)  represents  the  number  of  arrivals  until  a  balk  occurs, 
conditional  on  an  initial  amount  y  of  waiting  time  in  the  system),  and 

M(y)  =  inf  [n  >  o|w  =0   or  W  >  (K-2)b;  W^  =  y]         (4.3.2) 

(so  that  M(y)  is  the  number  of  arrivals  until  a  customer  either  enters 
an  empty  queue  or  balks,  conditional  on  an  initial  amount  y  of  waiting 
time  in  the  system). 

It  is  clear  that  M(y)  has  the  equivalent  representation 

M(y)  =  inf  [n  >  o|s   ^  -y'   or   S   >  (K-2)b-y'} 
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and,  hence,  is  the  index  at  which  the  random  walk  [S^;  n  =  1 .2 . 3 .  .  .  . }  ^ 

first  leaves  the  interval  (-y' , (K-2 )b-y  ]•  I 

Finally,  let  J  =   J(y)  be  the  random  variable  that  represents  | 

the  number  oE  customers  who  enter  an  empty  queue  prior  to  the  first  ] 

person  to  balk,  conditional  on  an  initial  amount  y  of  waiting  tune  in  | 

the  system.   That  is ,  J  is  the  number  of  times  the  waiting  time  process  \ 

W^  (n  ^  1)  takes  the  value  zero  before  it  takes  a  value  greater  than  (K-2)b: 

First  we  shall  prove  a  few  lemmas  that  lead  to  a  theorem  which  : 

expresses  e(N(y))  in  terms  of  expectations  and  probabilities  associated  | 

with  the  random  variables  M(y),  S^^^^^,  M(0),  and  S^^^^)"   ^°^^  ^'"'  "'""  I 

K=  2,  M(0)  =  M(y)  =  1   and  S^^^^   -  S^^^^^  =  b-u^.  I 

I 

Lemma  t^ .  3  . 1  i 

Pr{j  =  0}  =  PrfS^^y)>  (K-2)b-y'}. 


M(y) 


^^KiO^^   ^^^-2^^^'  '  ^   ' 


Proof  of  Lemma  4.3.1 

Define 

L^  =  M(y), 

L.  =  inf  [n  >  L.  .|w  =  0  or  W^>(K-2)b;  W^  =  y} ,   3^2 

(so  that  L.  is  the  index  of  the  j-th  person  to  balk  or  enter  an  empty 
queue).   Keep  in  mind  that  L.  is  a  function  of  y. 


Novr,  if   j  =  0, 

00 

Pr[j  =  0}  =  E   Pr[j  =  0,  N(y)  =  n] 
n=l 


=  E   Pr{0  <  W,  S  (K-2)b, .. .,0  <  W   ,5  (K-2)b, 
T  i  n- 1 

W^>  (K-2)b|wQ  =  y} 


n=l 


E   Pr{0  <  S   +  y'   ^    (K-2)b, . . .,0  <  S     +  y'  ^  (K-2)b, 
n=l         ^  "'^ 

S^  +  y'  >  (K-2)b} 

00 

E   Pr[M(y)  =  n,  S^,  ,  +  y'  >  (K-2)b} 

n=i  ^*^y) 


=  ''^'^M(y)  >  CK_2)b-y'}. 


For   j  s  1, 


Pr{j  =  j}  =  Pr[WL^  =  0,  Wl^  =  0,...,V-^.    =  0, 

WLj^I  ^  (K-2)bIW(^  =  y} 

=  P'^fWLj  +  i  >  (K-2)b|wL^  =  0}  Pr[WL^.  =  o|Wl^._^  =  O) 

...Pr{WL2  =  °!Wli  =  0^  Pr[WL^  =  o|Wq  =  y} ,         (4.3.3) 

the  last  equality  following  from  the  Markov  nature  of  W  .   But  we  have, 
Pr{WL^  =  0|Wq  =  y)  =  Prlw^^^^  =  o|Wq  =  y] 


n=l       ^ 


^   ^'^^^Mfv^  •*■  y'  ^  0,  M(y)  =  n] 
n=l      ^^^ 
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and 


Pr{WL.^^  =  0|W^   =  0}  =  E   Pr[L.^^  -  L.  =  n,  W^     =  OJW^   =  O] 
i        n=l  i  +  l       L 


=  E   Pr{0  <W^^^  ^  (K-2)b,....0<W^^^_^ 


n=l 


^  (K-2)b,  W.     =  0|w,   =  0} 
Li.+n      L. 


^      Pr[0  <  S,  ^  (K-2)b, . ..,0  <  S   , 
,1  n-1 

n=l 

^  (k-2)b,  S  s:  0} 


=   E   Pr{Mro)  =  n,  S^^Q)  ^  O} 
n=l 

=  Pr[Sj^^Q^  SO},    1  s  i  r:  j_i.        (4.3.5) 

Following  a  proof  analogous  to  that  used  to  obtain  (4.3.5),  wa  get 

Pr{w^    >  (K-2)b|w^  =  0}  -  Pi^lS^    >  (K-2)b}  .  (4.3.6) 

J  +  1  J 

Applying  (4.3.4)  through  (4.3.6)  to  (4.3.3),  we  complete  the  proof. 
Lemma  4.3.2 


e(N(y)|j=0)  =  e(M(y)|s^^  ^  >  (K-2)b-y'), 

e(N(y)|j  =  j)  =  S(M(y)|s^j^y^  ^  -  y') 

^    (j-1)  e(M(0)|s^^Q^  ^   0) 

*  e(M(0)|s^^Q^  >  (K-2)b),    j  S  1 
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Proof    of  Lenirna   k  .3  .2 

Pr{N(y)    =   n|j   =    O]    =    Pr{N(y)    =   n,    J   =   0}/Pr{j    =   O] 

=   Pr[0  <  S      +   y'    S    (K-2)b,...,0   <  S      ^    +    y'   5    (K-2)b, 
J-  n-1  ' 

S      +   y'   >    (K-2)b}/Pr[j   =   O} 

=    Pr{M(y)    =    n,    S^^^^^    +    y'    >    (K-2)b}/Pr [S^^^^    +    y'    >    (K-.2)b] 

=   Pr{M(y)    =   nls^^y^  >    (K-2)b-y'}, 

and  therefore 

e(N(y)|j    =    0)    =   e(M(y)|s„,    ,   >    (K-2)b-y'). 

For      j   -   1,    note   that 

e(N(y)|j   =    j)    =   SCLj^Jj    =    j) 

=  cajj  =  j)  +  ea^-L.Jj  =  j)  +  ...  + 

e(L^^^    -   L^|J   =    j).  (4.3.7) 

We   now  solve   for   the   various    terms    in   the   last   expression   of   equa- 
tion   (4  .  3  .  7  )  . 

00 

eajj   -    j)   =     E     n   Pr{j   =   j,    L^   =   n]/Pr[j   =   j] 
n=l 

»  n   Pr{w^=0,...,WL^=0,WL  >    (K-2)b,L^    =   nlw^   =   y] 

n-1  Pr[j   =    j] 

00 

=  i:  n  Pr[WL   >  (K-2)b|wL.  =  O]  Pr{WL.  =oiwL.  .  =0] 
n=l       -J  J  J      J--L 

.       ,       ,  Pr[WL  =0,  L   =  n|w   =  y] 

...Pr{WL„  =0|Wl,  =0} i 1 ^ 

^  Pr{j  =  jj 

00 

=  E   n  Pr[WL^  -0,  L   =  nlw^  =y}/Pr[WL^  =o|w  =  y] 
n=l 
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E   n  Pr[M(y)  =  n|Sj_j.  .  +  y'  ^  0} 
n  =  l 


The  second  equality  from  the  last  follows  fron;  (4.3.3)  and  the  next  to 
the  last  equality  follows  from  (i|.3.U).   Using  similar  techniques  as 
those  employed  in  deriving  (U.3.8),  we  have 

ea.^^  -  lJj  =  J-'  =  ^^M(o)|s^^Q)  ^  0),    i^i^  j  -1,         (4.3.9) 

and 

ea.^^  -  L.|J  =  j)=^(M(0)|s^(Q)>(K-2)b).  (U.3.10) 

Applying  (U.3.8)  through  (U.3.10)  to  (i;.3.7),  v/e  complete  the  proof. 
We  are  now  ready  to  find  the  expression  for  c.(NCy)). 

Theorem  4.3.1 


I 


If   K  2  2,  then 


e(N(y))  =  e(M(y))  +  e(M(0))  . 

and,  in  particular,  if   K  =  2,  then 

t^(N(y)  =  1  +  [l  -  F(b+y'-0)]/F(b-0). 

Proof  of  Theorem  4.3.1 

For   K  ^  2,  let  A(y)  be  the  event  {S^(^^,^   +y'  >  (K-2)b}  and  A  (y) 
the  complement  event   [S^^^  ^  +  y'  ^  O}.   Further,  let  p(y)  =Pr{A(y)3 
and  q(y)  =  PriA'Cy)]  =  l-p(y)-   We  have,  by  Lemmas  4. 3.1  and  4.3.2,  that 
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e(N(y))  =  E  e(N(y)|j  =  j)  Pr[j  =  j} 
=  t^(M(y)|A(y))  p(y) 

00 

+  e(M(y)|A'(y))  q(y)   E   q(0)J"^  p(0) 

j  =  l 

00 

+  e(M(0)|A'(O))  q(y)   E   (j-1)  qCO)^'"^  p(0) 

j  =  l 

oo 

+  e(M(0)|A(0))  q(y)    E   q(0)J"^  p(0) 

j=l 

=  e(M(y))  +  e(M(0)|A'(0))  q(y)  [l/p(0)  -  IJ 

+  e(M(0)|A(C))  q(y) 
=  S(M(y))  +  q(y)  [P.(M(0)  |  a' (0)  )  (q(0)/p(0)) 

+  pXM(0;|a(0))  (p(0)/p(0))] 
=  e(M(y))  +  e(M(0))  q(y)/p(0), 
and  the  first  half  of  the  theorem  is  proved. 
For  K  =  2,  we  have  immediately  that 
Pr{N(y)  =  l}  =  Pr{w^  >  o|Wq  -  y} 

=  Pr{S^  +  y'  >  Oj 

=  Pr{u^  <  b  +  y'} 

=  F(b+y'-0) 

=  Pr{j  =  0}  (4.3.11) 

and 

Pr{N(y)  =n}  =Pr[w^  =0,  •.•,W^_^  =0,W^>o|Wq  =  y] 

=  Pr[b-u, +y'  ^  0,b-u^  ^  0, . . . ,b-u  '  ,  ^  0,  b-u  >  O} 
1  -^         2  n-1         n 

=  [1  -  F(b+y'-0)]  [1  -  FCb-O)]"""^  F(b-O) 

=  Pr[j  =  n-l],    n  ^  2.  (^4.3.12) 
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From  (4.3.11)  and  (4.3.12),  '^(N(y))  tor  the  case  K=2  followe  trivially, 

thus  completing  the  proof. 

We  now  proceed  to  find  an  approximate  expression  for  £(N(y)) 

when  K^3.   Since  M(y)  represents  the  index  of  first  passage  of  the  random 

walk   [S  ;  n  =  1,2,3,...)  out  of  the  interval  (-y  ,(K-2)b-y  ],  \;c  take 
n 

y>0  (and  hence  y  >0)  so  that  we  can  use  Wald's  approximation  to  yield 
the  following  results  for  the  random  variables  M(y)  and  S  .  ..   See, 
for  example,  Ferguson  (1967). 
Let 


cp(0)  =  J     e'^"^  dF(u), 
o 


(4.3.13) 


and    9_   be   the  non-zero  solution    (if    it   exists)    of 
exp    (e^b)  cp    (8q)    =   1. 


(4.3.14) 


We  then  have,  for  y  >  0   and   K  ^  3, 


and 


^^^^Hiy)''^^-^^^-y"^ 


y'/(K-2)b,  e(u^)  -  b, 
y    1  -  exp(-9Qy  ) 


(4.3.15) 


exp(eQ  r(K-2)b-y  ])  -expC-e^^y  ) 


e(u^)  /  b, 


7—  ' 


e(M(y))  =  y'[(K-2)b-y']/Var(u^),        e(u^)  =  b, 
e(M(y))  =    (l/(b-e(u^)))i-y'(exp(9Q[(K-2)b-y'])  -  1) 

*  [(K-2)b-y'](l  -  exp(-eQy'))} 

•  fexp(eQ[(K-2)b-y'])  -  exp(-9Qy' )}  "\ 

e(u^)  /  b. 


(4.3.16) 
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By  the  use  of  Theorem  ^^3.1,  and  equations  (4.3.15)  and 
(4.3.16),  an  approximate  expression  for  S(N(y))  may  be  obtained. 
However,  if  y  =  0,  then  the  above  approximations  give. 

e(M(0))  =  Pr[S^^Q^  >  (K-2)b}  -i   0. 

Hence,  the  substitution  of  these  quantities  into  the  expression  of 
Theorem  4.3.1  yields   0/0,  an  undefined  quantity.   To  circumvent  this 
difficulty,  we  write 

e(M(a))  Pr[S^,  .  ^  y'] 

fi(N(y))  =  e(M(y))  +  1  im  . ^^ — - 

a-0  ^'^fS^(a)  "-    (K-2)b-a'}   ' 

and  substitute  the  approximations  before  taking  the  limit.  We  have  after 
simplification,  for  K  5  3^ 

e(N(y))  =  [(K-2)b-y'][(K-2)b+y']/Var(u^),      ^(u^)  =  b, 

e(N(y))  =  [(K-2)b-y']/(b  -  e(u^)) 

(cxp(eQ(K-2)b)  -  exp(eQy')) 


^Q<ih  -  e(u^)) 


e(u^)  /   b.    (4.3.17) 


It  will  be  shown  in  Theorem  4.3.3  that  (4.3.17)  can  be  used  to  put  an 
upper  bound  on  C (V   ).   The  next  two  lemmas  and  the  theorem  following 
them  help  us  to  attain  this  goal,  while  giving  insight  into  why  we 
have  devoted  much  effort  to  obtain   fi(N(y)). 
Let 

Y.  =  Wj^.,  j  ^  1,  (4.3.18) 

(so  that  Y.  is  the  amount  of  waiting  time  in  the  system  immediately 
prior  to  the  j-th  balk). 
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Lemma  4.3.3 


The  stochastic  process   (y.;  j  =  1,2,3,...}   is  a  time-horaoceneous 
Markov  process  on  the  continuous  state  space   ((K--2)b,  (K-l)bJ. 


Proof  of  Lemma  4.3.3 

By  the  definition  of  N .  in  Section  4.1,  the  state  space  is  as 

described.   For  1  ^  i,  <  i^  <  . . .  <  i  <  j ,  by  the  Markov  and  time- 

12  m 

homogeneity  properties  of  W  ,  we  have 

=  Pr{WN2  ^  x|Wj^^  =  y] 

=  Pr{Yj  S  x|y^  =  y}, 
thus  completing  the  proof. 

Lemma  4.3.4 

(a)   The   distribution   of   M.^      conditional    on   Y.    =   y 


(b 


is  the  same  as  that  of  N(y)  for  j  ^  1. 

)  The  distribution  of  V.^   conditional  on  Y.  =  y 

is  the  same  as  that  of  c  _  a   for   j  -  1. 

N(y)     0 


(c)    min   e(N(y))  ^  ^CM.)  ^     max  e(N(y)),     j  ^  2. 
(K-2)b<y^(K-l)b      '      (K-2)b<y^(K-l)b 
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Proof  of  Lemma  4.3.4 


By  the  Markov  nature  of  W  ,  we  have 
Pr{M.^^  =  n|Y^  =  y} 

=  Pr{W^  ^^  ^  (K-2)b,...,  Wj^  ^^  ^  S  (K-2)b, 
J  J 

W^  ^  >  (K-2)b|w^.   =  y] 
J  3 

=  Pr{w^  S  (K-2)b,...,  W^_^  S  (K_2)b,  W^  >  (K-2)b|WQ  =  y] 

=   Pr{N(y)   =   n}, 
completing    part    (a)    of   the    lemma. 

Further,    since   u    jU^jU,, ...,    are  mutually   independent   and 
identically  distributed, 

PrfV.^jY     =y}    =Pr{u^_,^    .....   u^,_        .k|w^_    -y} 

J  J  +  1  J 

CO 

n=l  3  J  -^  J 

00 

=      E      PrfcT^   _   a^  ^   X,    N(y)    =   n] 
n=l 

"^^    N(y)     0    '^-*' 
and  the  (b)  part  is  proved. 

Finally,  from  the  (a)  part  of  the  lemma,  we  have,  for  j  ^  1, 

e(M     )  =  e  {e(N(Y.))}. 

■'      Y.      J 
J 

But,  by  Lemma  4.3.3,  (K-2)b  <  Y.  ^  (K-l)b,  so  that  part  (c)  of  the 

lemma  follows.   The  proof  is  now  complete. 

Note  that  Y  , Y  , Y  ,  ...,  are  not  identically  distributed  unless 

Y  has  the  same  distribution  as  the  stationary  distribution  of  Y. . 
1  J 
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Therefore,  Lemma  U.3.U  implies  that  neither  M  ,M  ,M  , ...,  nor 

V  ,V  ,V  ,...,  are  identically  distributed  sequences  of  random  variab]es 

in  general  • 


Theorem  4.3.2 


(a)  e(o^(^^  -  a^)  =  e(N(y))  e(u^), 

(b)  e(v.)  =  e(M.)  ecu,),  j  ^  i, 

with  u  given  by  (4.1.2). 


Proof  of  Theorem  U.3.2 


* 

Let    3      =   o     -  c     so  that 
n  n  C 


* 

a     =u,    +...+U,  n>l. 

n  I  n 


e,    * 


The   sequence     ct     -   n  f(u,  )      forms    a  martingale   and  ''(cJ     -n   ^-(u.))    -   0 
^  n  1  n  i 

*  * 

for      n  >   1.      Let   B,    be    the  O-field   of   events    generated  by    C^, ,.-.,9,), 
— k  IK 

then   the  event      {N(y)  >  k]    e  B      and  B     c:  B        .      Hence,    N(y)    is    an 

optional    stopping   rule   and   therefore   has    no  effect    on   the  martingale 

property.      See,    for    example,    Feller    (1966).      We   now    have 

£(a        ,    _   N(y)   e(u,))    =   0,   which  establishes    part    (a)    of   the   theorem. 
N(y;  ^  1 

By   Lemma  4.3.4   and   part    (a)    above,    we   can  write 

e(y.^^)  =e.fS(v.,jY.)} 

=  e    {e-(N(Y.))  e(u, )} 

Yj  J  1      • 

=  e(u,)  e  [e(N(Y.))] 

1      Yj  J 
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Simil airly,   we   have 

The   proof    is    nov;   counplete. 

If    one   could   obtain   the  exact   value   of      S(M.),    then    the   above 

J 

theorem  implies  C(V.)  could  be  easily  found.  However,  the  best  we  are 
able  to  do  is  obtain  an  approximate  upper  bound  for  G(V.)  when  K  ^  3. 
An  exact  upper  (and  lower)  bound  for   C(V.)  when  K  =  2   can  be  obtained 

n 
J 

directly  from  Theorem  4.3.1.   No  approximate  lower  bound  for  G(V.)  in  the 
case   K  -  3  can  be  found  since,  when   y  =  (K-l)b  (or  equivalently 
y  =  (K-2)b),  the  approximation  (4.3.17)  yields  a  value  of  zero.   We  now 
state  formally  the  results  that  can  be  obtained.   Since  they  hold  for 
all   j  5  2,  the  steady  sto.te  solution  satisfies  these  bounds  also. 

Theorem  ^-3.3 

Let   6   satisfy  (4.3.14). 
If   K  =  2,  then 

e(u  )/F(b-o)  s  e.(v.)  s  e(,u^)  [i  +  i,/F(b-o)j,       j  s  2. 

1  J  1  J3  J 

If   K  -  3,  then,  approximately, 

S(V.)  £  e(u^)  (2k-5)  b^/Var(u^),  e(u^)  =  b. 


and 


e(v.)  ^  b  e(u^)/(b-e(u^)) 


e(u^)  (exp(eQ(K-2)b)  -  exp(9Q(K-3)b) 


Q^ih  -  e(u^)) 


e(u^)  /  b,    j  2  2. 
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Proof  ot  Tlieorem  ^.3.3 

By  Ler.ima  h  .3  .hCc) ,    wc  ncc-d  the  maximum  and  minimum  o£   C(N(y)) 

from  Theorem  i4.3.l    for  y  in  the  range  (!C-2)b  <  y  ^  (K-l)b,  or  equiva- 

lently,  (K-3)b  <  y'  ^  (K-2)b  to  obtain  bounds  for  C(M.).   The  exact 

J 

bounds  for  C(N(y))  when  K  =  2  are  taken  directly  from  the  expression 

in  the  theorem,  while  the  approximate  results  for  K  ^  3  are  obtained 

from  (4.3.17).   It  is  easily  shown  that  the  lower  bounds  are  reached 

when  y   =  (K-2)b  arid  the  upper  bounds  when   y   =  (K-3)b.   By  Theorem 

4.3.2(b)  we  need  only  multiply  these  bounds  by  C(u  )  to  complete  the 

proof . 

Finally,    let    F„(-)    denote   the   stationary   distribution    of    Y.. 

That    is,    F    (•)   satisfies 

(K-l)b 
Fy(x)  =  /       PrfY^  2  x!y^  =  y}  dF.^.(y),  (U.3.19) 

(K-2)b 
when  (K-2)b  <  x  ^  (K-l)b.   If  Y  has  the  distribution  F  (•),  then  it  is 
well  known  that  Y.  has  the  distribution  F  (•)  for  all  j.   See,  for  example, 
Feller  (1966).   We  then  have,  by  Lemma  4.3.4,  the  following  theorem. 

Theorem  4.3.4 

If  Y  has  the  distribution  F  (•)  that  satisfies  (4.3.19),  then 

(a)  M  ,M  ,M  , ...,  are  identically  distributed, 

(b)  V  ,V  ,V  ,  ...,  are  identically  distributed,  and 

(K-l)b 

(c)  e(M.)  =  r       e(N(y))  dF^(y),  j  ^  2, 

J      (K-2)b  ^ 

with     C(N(y))    given   by  Theorem  4.3.1. 


CHAPTER  5 
THE    INVENTORY  PROBLEM:      DISCRETE    CASE 

5.1      Definition   of    the   Inventory   System 

V7e   suppose  there  exists    a   subv^arehouse,    maintaining   an    inventory 
of   finite   capacity  S,    that    holds   material    (discrete)    for   future   demand. 
We   assume   the    item-by-item  demand   for   the   stored    objects    occurs    accord- 
ing  to   the  stochastic   process      [D(t);    t   ^  0}      defined  by 

D(t)    =     E      U(t    -   T.)  (5.1.1) 

j  =  l  ^ 

with  U(')    the   unit    step   furiction   at    zero.      It  will   be   assuir.ed   thar    the 

inter-demand   times,    t      _  t        t      _  t        t      _   T       ...,    for    the    items    in 

2.  i    J     2    4     J 

Storage  are  mutuallv  independent  and  that  the  distribution  of  t.  -t. 

J    J-1 

is  given  by 

Pr{T.  _T.   s  u]  =  G(u),     u  s  0,   i  -  2.  (5.1.2) 

In  order  to  maintain  a  stock  on  hand,  the  subwarehouse  places 
an  order  for  replacement  items  to  a  warehouse.   It  will  be  held  that 
items  are  so  ordered  in  lots  of  integral  size  v(l  ^  v  ^  3)  and  that 
orders  are  placed  at  the  times   <7  a  a   .  .  . ,  with  c.  defined  by 

1    Z    o  J 

O.   =    inf  {t|D(t)  =  j  v],  j  "  1.  (5.1.3) 

From  the  definition  of  D(t),  we  have  ^ .  =  T  .   so  that  '^o  -  ^i  >  '^•^  ~^9' 

<7.  -O'   .  ..,  are  mutually  independent  and  C' .  _  a  .    has  distribution 

J    J- 1 
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Pr{o.  -o.    ,    ^   x}    =  G(x),  X   ^  0,      j   ^   2,  (5.1.4)      \ 

where  G    (•)    is    the   v-th   convolution   of   G(-)   with   itself.  : 

Let      [S(t);    t  5  0}   be   the  stochastic   process    such   that   S(t)  | 

represents    the    inventory   or   stock  level    in   the   subwarehousc   at    time   t. 

If   we   let      [R(t);    t   ^  0}   be   the   stochastic   process   such   that  R(t)    is  i 

the  number   of   orders    filled  by  the  warehouse    in      [0,t]      for   our   sub- 

warehouse   of    interest,    then   S(t)   will   be   defined  by 

I 
S(t)    -   S    -    D(t)   +   VR(t).  (5.1.5) 

The  above  definition  assumes  that  the  inventory  is  initially  full,         | 
i.e.,  3(0)  --^  S.  ; 

1 

An  order  for  replacement  stock  of  lot  size  v,  made  at  time  <^ ,  ; 

may  be  one  of  two  types.  We  have  a  "regular"  order  provided  that 
S(C)  >  S  -  v[s/v],  where  [x]  means  the  integral  part  of  x.   In  this  case,   i 

the  time  to  fill  an  order  (hereafter,  the  service  time)  is  assumed  to  be   '. 

I 
a  random  variable.   The  successive  regular  service  times,  denoted  by       | 

w  ,w  ,w^,...,  are  assumed  to  be  mutually  independent  and  independent  of    1 

the  demand  process  D(t).   The  distribution  function  of  w.  is  given  by      ] 

Pr[w.  S  w]  =  H(w),     w  ^  0,   j  ^  1.  (5.1.6) 

We   have   an   "emergency"   order    if      S(a)    =  S    -  v[S/v].      In   this    case,    the  ' 

1 

emergency  service  time  is  supposed  instantaneous,  or  at  least  effec-       j 

tively  zero,  so  that  S(.o   +  0)  =  3  -  v[s/v]  +  v.  • 

i 

In  other  words,  regular  ordering  procedures  are  used  provided 

I 
I 
that  at  the  time  we  place  such  an  order,  there  are  at  least  \>    items  in 

i 
the  subwarehouse .   If  there  are  less  than  v  items  in  the  subwarehouse      t 
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when  an  order  is  placed,  we  utilize  emergency  measures  to  obtain  the 
lot  of  V  items.   Utilizing  this  ordering  scheme,  we  avoid  the  disaster 
of  running  completely  out  of  stock  in  the  subwarehouse .   Figure  5.1 
gives  a  typical  realization  of  S(t). 

The  behavior  of  the  warehouse  in  filling  the  regular  orders  is 
important  to  a  discussion  of  the  inventory  problem.   It  will  be  assumed 
that  the  warehouse  operates  under  one  of  two  distinct  systems.   Under 
the  first  system,  the  warehouse  can  handle  only  one  order  at  a  time,  so 
that  successive  orders,  which  arrive  while  an  order  is  being  filled, 
form  a  queue  and  must  wait  to  begin  being  processed  or  "served." 
The  orders  are  then  processed  by  the  warehouse  according  to  a  strict 
rotation  basis  of  "first  come,  first  served."  The  warehouse  just 
described  will  be  called  the  one-server  warehouse.   Under  the  second 
system,  an  order  begins  processing  as  soon  as  it  arrives  in  the  ware- 
house so  that  no  order  must  wait  for  "service."  A  warehouse  operating 
under  this  procedure  will  be  called  an  infinite-server  warehouse.   We 
shall  consider  both  one-server  and  infinite-server  warehouses. 

We  now  state  the  following  formal  definition  of  the  concepts 
discussed  so  far. 

Definition  5.1.1 


The  ordering  scheme  (G,H,S,v,l)  is  a  policy  for  maintaining  the 
level  of  inventory  in  a  subwarehouse  where: 

(a)  The  capacity  of  the  inventory  is  S. 

(b)  Item-by-item  dem.and  for  objects  in  storage  satisfies  (5.1.1) 
and  the  inter-demand  times  are  mutually  independent  random 
variables  v/ith  distribution  function  G(  • )  - 
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(c)  Lots    of   V    items    (1   5   v  s   S)    are   ordered    at    the   times 
given   by    (5.1.3). 

(d)  The   orders    are  made    to   a   one-server  warehouse. 

(e)  Regular  service  times  are  mutually  independent  random 
variables,  are  independent  of  the  demand  process,  and 
possess  a  distribution  function  H( • ) • 

(f)  Instantaneous  service  occurs  for  orders  placed  when  less 
than  V  items  remain  in  storage  at  the  time  an  order  is 
placed. 

If  we  change  condition  (d)  of  the  definition  to  state  that  orders 

are  made  to  an  infinite-server  warehouse,  we  have  the  ordering  scheme 
(G,H,S,v,ot=). 

Clearly,  the  cost  of  maintaining  the  inventory  level  in  the 
subwarehouse  will  be  a  function  of  v,  the  lot  size  ordered.   The  optimal 
value  of  the  lot  size  is  defined  herein  to  be  that  value  of  v  which  min- 
imizes the  cost.   It  has  to  be  remembered,  however,  that  frequently  not 
all  values  of  v  are  available  to  us  since  orders  to  the  warehouse  may 
have  to  be  in  multiples  of  ten,  a  do7en,  a  gross,  or  some  other  basic 
unit.   Our  best   v   is  that  of  finding  the  optimal  attainable  value  of 
V.   In  Section  5.3,  a  cost  function  is  defined  that  utilizes  reasonable 
costs  associated  with  maintaining  the  inventory  level . 

While  searching  for  a  minimum  cost  with  respect  to  v,  v  may 
take  all  values  from  1  to  S .   Therefore,  the  distribution  on  regular 
service  times  could  quite  possibly  be  a  function  of  v,  the  lot  size 
ordered. 
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5.2  Re latlon  of  the  Inventory  System  to  Queues 


with  Balking 


Recall  from  Section  5.1  that  S(c^)  is  the  stock  level  at  the 
time  the  k-th  ordar  is  placed.   S(a^)  tells  us  v/hether  an  order  is 
regular  or  emergency.  Since,  realistically,  emergency  orders  have 
large  costs  (more  than  the  costs  of  regular  orders),  the  value  of  S(.o^) 
is  of  extreme  importance  in  determining  the  cost  of  maintaining  the 
inventory  level  in  the  subwarehousc .   A  study  of  the  properties  of  S(a^) 
can  be  facilitated  by  making  the  following  observations.   From  equa- 
tions (5.1.5)  and  (5-1.3),  we  have 

S(a  )  =  S  -  D(a^)  +  "JRCo^) 

=  S  -  vfk  -  R(\)}-  (5.2.1) 

Define  the  stochastic  process  (QCt);  t  -  0}  by 

Q(t)  =  [D(t)/v]  -  R(t),  (5.2.2) 

where  [x]  is  the  integral  part  of  x,  so  that  Q(t)  represents  the 
number  of  unfilled  orders,  for  our  subwarehouse  of  interest,  at  time  t- 
From  C5.2.1)  and  (5-2.2),  we  have 

S(a  )  =  S  -  vQ(a  )  (5.2.3) 

so  that  a  knowledge  of  Q(^j^)  gives  us  the  value  of  S(cJj^).   Therefore, 

a  study  of  the  stochastic  process   [Q(t);  t  -  O]  is  needed.   It  will       i 

i 
be  demonstrated  in  Theorem  5.2.1  that  such  a  study  has  been  carried  out    | 

i 

I 

for  some  special    cases    in   Chapters   2    through  4-  i 
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For  the  cost  functioi!  to  be  defined  in  Section  5.3,  we  will 
make  use  of  the  following  random  variables.   Define 

N^  =  inf  [k  >  o|s(aj^)  =  S  -  v[S/v]], 

N  =  inf  [k  >  N    !s(a  )  =--  s  -  v  [S/vJ),   n  ^2     (5.2.4) 
n  n~  i    K 

(so  that  N   is  the  number  of  orders,  regular  and  emergency,  placed  up 
n 

to  and  including  the  n-th  emergency  order),  and 

^  =  %' 

V^  =  o^.    -   a^._^,  j  >  2  (5.2.5) 

(so  that  V   is  the  time  until  the  first  emergency  order  is  placed  and 
V.  (j  ^  2)  is  the  time  between  the  (j-l)-st  and  j-th  emergency  orders). 

Theorem  5.2.1 


For  an  ordering  scheme  (G,H,S,v,l)  (  (G,H,S,v,a>)  )  we  have  the 
following  dualities. 

(a)  Q(t)  is  the  number  of  people  in  the  system  at  time  t  for 
the  queue  G  /H/1   (G  /H/'^)  with  balking  at  queues  of 
length  [S/v]  -  1. 

(b)  N  is  the  number  of  people  who  arrive  in  the  system  up  to 
and  including  the  k-th  person  to  balk  in  the  queue  G^/^/1 
(G  /H/°°)  with  balking  at  queues  of  length  [S/v  ]  -  1. 

(c)  V   is  the  time  until  the  first  balk  and  V   (j  ^  2)  is 
the  time  between  the  (j-l)-st  and  j-th  balks  in  the 
queue  G  /H/1   (G  /H/=°)  with  balking  at  queues  of 
length   [S/v J  -  1. 
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P r oof  of  Theorem  5.2-1,  Part  (a) 

By  definition  (5.2.2),  we  have 

Q(t)  =  [D(t)/v]  -  R(t). 

Now   [D(t)/v]  has  unit  increases  at  the  times  '^^  ."^2 ' '^3 '  "  " '  ^°  ^^^^ 
Q(t)  also  has  unit  increases  at  these  times.   Hence,  the  order  time 

a  can  be  considered  as  the  arrival  time  of  a  "customer"  into  the 
J 

warehouse . 

R(t),  by  definition,  is  the  number  of  orders  filled  by  the 
warehouse  in   [0,t].   The  time  it  takes  to  fill  a  regular  order  is 

w  .   Since  R(t)  increases  by  a  unit  amount  at  the  time  an  order  is 

J 
filled,  Q(t)  decreases  by  a  unit  amount  at  that  time.   Therefore,  w^ 

is  the  service  time  of  a  "customer"  in  the  warehouse. 

Finally,  by  the  restriction  of  emergency  orders  and  (5.1.5), 

<7,  is  such  that 
k 

S(a     +0)   =   S  -v[S/v]  +v     when     S(a   )   =   S  -v    [S/v], 
k  '^ 

if   and   only   if 

R(.a^  +   0)    =  R(a^)    -t-   1. 

Hence,  from  (5.2.2)  and  (5.2.3) 

S(a  +0)  =  S  -vTS/v]  +v  when  S(o)=S-v[S/v] 
k  "^ 

if  and  only  if 

n(c     +0)    =    [S/v]-l      when     Q(^.)    =    [S/v]. 
k  "^ 

Therefore,    a   "customer"  balks    at   the   queue   of    length   [S/v]   -   1. 

By   the  assumptions    placed   on   the  ordering  times   and   the   service 
times   for   the  ordering   scheme,    and   the  discussion   of   a    queue  with 
balking    in  Section   2.1,   we   complete   part    (a)   of    the   proof. 
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Proof  of  Theorem  5.2.1,  Parts  (b)  and  (c) 
Simply  note  by  (5.2.3)  that 

N^  =  inf  [k  >  0\Qio^)   =  [S/v]}, 

N^  =  inf  [k  >  N^_jQ(aj^)  =  [S/v]},     n  >  2. 

By  part  (a)  of  the  theorem  and  definitions  in  Section  2.1,  we  complete 
the  proof  . 

5.3  The  Cost  Function  C(v) 


For  the  inventory  problem  discussed  in  Section  5.1,  consider  the 
following  costs  associated  with  running  the  ordering  scheme  (G,H,S,v,l) 
or  (G,H,S,v,<"): 

C^:      The  cost  of  placing  an  order, 
C  :   The  per  unit  cost  of  the  commodity,  and 

C  :   A  penalty  cost  for  instantaneous  deli\'ery  of  an  emergency 
order  that  is  possibly  a  function  of  v,  the  lot  size 
ordered. 
Define  the  stochastic  processes   {N(t);  t  >  O]  and  fM(t);  t  -  O} 


by 


and 


NCt)  =  E  U(t  -  cr.)  (5.3.1) 


M(t)  =  E   U(t  -  o^.)  (5.3.2) 

j  =  l         ^ 


with  Cf.  given  by  (5.1.3)  and  N.  by  (5.2.4).   Then  N(t)  is  the  total 
number  cf  orders  placed  in  the  interval   [0,t]  (regular  and  emergency) 
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and  M(t)  is  the  number  of  these  that  are  emergency  orders.   Definitions 
(5.3.1)  and  (5.3.2)  are  not  the  same  random  variables  as  defined  by 
(4.3.1)  and  (4.3.2),  respectively. 
Lett 

C(v;t)  =  (Cq  +  C^v)  N(t)  +  C2M(t)  (5.3.3) 

so   that   C(v;t)    is    the   total    cost   of   ordering   lots    of   size  v   during   the 
time    interval      [0,t].      Since      N(t)    and  M(t)    are   randoai   quantities,    we 
shall    concern   ourselves   with   the   expected   total    cost,    C[c(v;t)],    during 
the    interval      [0,t].      Further,    the   v  which  minimizes      ^{C(v;t_)}    for 
a   fixed   t„  will   minimize     C{C(v ; t„) }/t^ ,    so   that   we   shall    restrict   our- 
selves   to   the   latter    quantity.      Finally,    since   a   subwarehouse   that 
maintains    an    inventory    is    usually  established   with   the   thought    of    oper- 
ating  for   a    long  period    of    time,   we    choose   to  minimize   the  expected 
total    cost   of   ordering   per   unit    time    in   the   long   run,    a   quantity  that    is 
mathematically  tractable.      That    is,    we  want    the  value   of   v    (v    =    1,2,..., 
or  S)   that   minimizes 

C(v)    =    lira  e{c(v;t)/t} 
t-*° 

=    (Cq   +    C  V)    lim     £{N(t)/t} 

+  C^    lim     e{M(t)/t}-  (5.3.4) 

But   ^9  -  ^1  5  '^t'^o'  ^/i"^'^'"'"'  ^^®  mutually  independent 
and  identically  distributed  random  variables.   Therefore,  N(t)  is 
a  (delayed)  renewal  process  and,  by  the  Elementary  Renewal  Theorem, 
Prabhu  (1965a),  we  have 
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Lemma    5.3.1 


with 


lim  e{NCt)/t}    =   1/£(CT     -a   ) 
t-  °° 

=   l/v§  (5.3.5) 

CD 

§    =  /     u   dG(u).  (5.3.6) 

o 

A  similar  closed  form  for   lim  £{M(t)/t}  does  not  exist  for 

an  arbitrary  ordering  scheme  (G,H,S,v,l)  or  (G,H,S, VjOo) .   The  reason 

for  this  is  that  M(t)  is  a  function  of  the  random  variables  N.  whose 

J 

properties   depend   heavily  on   the  distribution   of   service   times   and 
whether  we   have   a   one-server   or    infinite-server  warehouse. 

In   the   foliov/ing   sections,   we   consider   reasonable   candidates 
for   the   distribution    function,    H('),    on   the  service  times   and   both  one- 
server   and    infinite-server  vjarehouses  .      For   the    cases    discussed    in   these 
sections,    a    "closed"    form   for      lira  £{M(t)/t}   will   be   obtained. 

^— •  so 

At  this  juncture,  it  should  be  pointed  out  that  when  [S/v]  =  1, 

Theorem  5.2.1  gives  N   =  k.   Therefore,   M(t)  =  N(t)  and 

lim  C[M(t)/t}  =  l/v§ .   For  the  future  we  shall  therefore  concern  ourselves 
t-oo 

with  the  cases   [S/v]  >  2. 
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a 


~~  with  Balking 


General  Demand  Function  I 

In  this  section,  wc  develop  the  solution  of  the  cost  function  \ 

C(v)  for  the  ordering  scheme  (G,M,S,v,l).  , 

The  subwarehouse  places  orders  of  lot  si.,e  v  with  a  one-server  I 

i 

warehouse,  so  that  orders  arrive  at  the  warehouse,  form  a  queue,  and  ] 

re  processed  on  a  strict  "first  come,  first  served"  basis.   We  are  j 

leaving  the  item-by- item  demand  function  D(t)  general,  but  we  are  j 

requiring  that  regular  orders  have  service  times  with  a  Markov,  or  \ 

negative  exponential,  distribution.   Therefore,  tne  distribution  of  w.  is  | 

Priw.^  w]  =  H(w)  ^    1  -  e-^".     w^O,   j  ^  1,        C5.U.1)  | 

J  I 

I 

where  lA  is  the  mean  service  time  to  process  an  order.  j 

It  is  reasonable  that  the  time  to  fill  an  order,  w^,  should  j 

depend  in  some  manner  on  v,  the  lot  size  of  the  order  placed.   We  may  j 
allow  for  this  by  permitting  that  ^  be  a  function  of  v.   Typically,  we 
may  have  X   =   a/^ ,    ^  a   constant.   In  order  to  find  the  value  of  v  which 
minimizes  C(v)  of  Section  5.3,  we  prove  the  following  theorem. 

Theorem  5.^.1 

For  the  ordering  scheme  (G,M,S,v,l),  the  cost  function  C(v)  of 

Section  5.3  has  the  form 

C(v)  =  (Cq+vC^)/§v  +  C^/lv    p.(v)  (5.4.2) 
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with 


where. 


and 


([S/vj-2) 


M-   (V) 


l/[[iiaO  -Z))]^-   Z],       [S/v]   s   2, 

[S/v]    =    1, 


K9)    =  /      e    ^'^  dG(u), 


§    =  J      u  dG(u), 


Proof   of   Theorem   5.U.1 

By  Lemiia    5.3.1,    we    need   only   find      lira  ^[!A(.t)/t]      to   complete 

f—t  en 

the   proof .      Now 


MCt)    =     E     U(t   -   a^,.) 


j  =  l 


N- 


Let      V^   =   aj^^      and     V .    =  o^^  .    -  Oj^ ._,       (j   >  2).      By  Theorem   5.2.1(c), 
<^-^ .    is    the  time   until    the    j-th  balk   occurs    in    the    queue      G  Ai/l      with 
balking   at    queues    of    length      [S/v]    -    1.      Hence,    we    can   apply  the   results 
of   Chapter   2  with 

K  =    [S/v], 
F(x)   =  G^(x),      and 

9(9)  =  [H^^f- 
From  Theorem  2.3.2,  we  therefore  have  M(t)  is  a  delayed  renewal 
process.   By  the  Elementary  Renewal  Theorem,  Prabhu  (1965a),  we  have 
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Urn  eiM(t)/t}    -    l/e(V    )  j 

=   1/v  §    p,(v) 

I 

I 

with      M-(v)    from  Theorem   2.2.2-      The    proof    is    now   complete.  i 

Writing    (5.4.2)    out,    we   see    that    C(v)    is    minimized  when  i 

I 

h(v)   --:    (l/v)[l    +    (C2/Cq)Ai(v)}  (5.i|.3) 

I 
is  minimized.   Therefore,  h(v)  can  be  considered  as  the  cost  function      j 

of  interest. 

1 

I 

\ 
Example:   Poisson  Demand  | 

Assume  the  itera-by-item  demand  for  objects  in  the  subwarehouse     i 

occurs  according  to  a  Poisson  process  with  intensity  |J..   Then 

I 
PrLD(t)  =  n]  =  e''^^  C^t)"/n'.  ,        n  ^  0,  | 

and   the    inter-demand   times    have   the   distribution 

Pr[T  .  _T.    ,    ^  x]    =  G(x)    =    1   -   a"^^,        x  -  0,      j   ^  2. 

That  is,  we  have  the  ordering  scheme  CM,M,S,v,l). 

To  apply  Theorem  5.4.1,  we  need  a  workable  expression  for 
g.(v). 

Define 

P  =  M-A 
and 

p  =  p/(l  +  p),    q  =  1/(1  +  p). 

From  (5.4.4),  we  have 

IrO)  =  (1  +  e/p)-^    . 


I 

I 
(5.4.4)  1 

I 
I 


78 


Hence, 


[K^(l    -   Z))]^   =    (1    +    (1   -   Z)X/M>)~^ 


=    (1    +    (1    -  Z)/p) 


=    pVCl     -    Zq)\ 


-V 


Therefore, 


p,(v)   =  c 


([S/v].2) 


p^/(l    -    qZ)^   -  Z 


-   C 


([SA]-2)    li 


^  -  q^ 


1  -  z 


1    -    qZ 


} 


^([S/v]..2)      -      ^j    I 

r-0   ' 


1    -    qZ 
P 


(j+l)v 


.      iz|  <  p' 


[SAl-2      ([SA]-j-2) 
E  C  [(1    -.    qZVpJ^J^l^' 

j=o  z 


[S/vj-2 
E 
j  =  0 


(j  +  l)v        I  ,      JS/v]-2-j   ^-(j  +  l)v 

[sA]-j-2p-q^  P 


equation    (5.4.3)    for      C   /C 


As    an    illustration,    Table   5.1   gives    the   values    of   h(v)    of 

10.0  and  various  values  of  p  and  S. 
It  is  to  be  noted  that  considerable  savings  can  be  effected  by  the 
proper   choice   of   v,    the   lot   size   ordered   to   replenish  the  stock. 
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TABLE    5.1 


VALUES   OF   h(v)    FOR  THE   ORDERING  SCHEME    (M,M,S,v,l) 


C^/Cq    =    10.0 


s 

8 

9 

10 

0.8 

1.2 

0.8 

1.2 

0.8 

1.2 

1 

1.5040 

3.1717 

1.3876 

3.0673 

1.3007 

2 .9877 

2 

0.5672 

0.7759 

0.5672 

0.7759 

0.5184 

0.6313 

3 

0.6260 

0.8743 

0.3634 

0.4461* 

0.3634 

0.4461 

4 

0.3i+75* 

0.4713* 

0.3475* 

0.4713 

0.3475 

0.4713 

5 

2.2000 

2  .2000 

2.2000 

2  .2000 

0.2347* 

0.2966* 

6 

1.8333 

1.8333 

1.8333 

1.8333 

1.8333 

1.8333 

7 

1.5714 

1.5  714 

1.5714 

1.5714 

1.5714 

1.5714 

8 

1.3750 

1.3750 

1.3750 

1.3750 

1.3750 

1.3750 

9 

1.2222 

1.2222 

1.2222 

1.2222 

10 

1.1000 

1.1000 

Denotes  optimal  value. 


5.5   Solution  of  C(v)  Using  the  Queue   GI/M/-^ 
with  Balking 

General  Demand  Function 

In  this  section,  we  develop  the  solution  of  the  cost  function 
C(v)  for  the  ordering  scheme  (G,M,S  ,  v  ,<==)  . 

The  subwarehouse  places  orders  of  lot  size  v  with  an  infinite- 
server  warehouse,  so  that  when  an  order  is  received  at  the  warehouse, 
processing  begins  immediately.   Once  again,  we  hold  the  item-by-item 
demand  function  D(t)  general,  but  we  require  that  regular  orders  have 
service  times  with  the  Markov,  or  negative  exponential,  distribution. 

Therefore,  the  distribution  of  w .  is 

3 

Pr{w.  S  w]  =  H(w)  =  1  -  e"  ^,        w  ^  0,    j  ^  1,  (5.5.1) 

where  1/X  is  the  mean  service  time  to  process  an  order. 

As  before,  it  is  reasonable  that  the  time  to  fill  an  order 
should  depend  in  some  manner  on  v,  the  lot  size  ordered.   We  may  allow 
for  this  by  permitting  K    to  be  a  function  of  v.   Typically,  we  may  have 
X   =  Cf/v ,  a   a  constant.   In  order  to  find  the  optimal  value  of  v,  we 
prove  the  following  theorem. 
Theorem  5.5.1 

For  the  ordering  scheme  (G,M,S,'w ,°°) ,  the  cost  function  C(v) 
of  Section  5.3  has  the  form 

C(v)  =  (Cq  +  V  C^)/v  §  +  C^/v  §  ^L(v)  (5.5.2) 

with 

tn([S/v],v),       [S/vJS2, 


p,(v) 

1,  [S/v]  =  1, 
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where     m(2 ,v), . . . ,m( [S/v ],v)   satisfy   tbe   relaLionships 


-V 


m 


(2,v)   =    [iK\)]~    , 


n  n 

m(n+l,v)   =    [t(n\)]"^[l    +     E  b^(n,n-k+2)     E     m(j,v)], 

k=2  j-k 


n   =   2,3,  ...,    [S/v]   -    1, 


with 


»        ft 
KS)   =    f     e'        dG(u), 


§   =  J     u   dG(u), 
0 


and 


n-k+2 
b^(n,n-k+2)   =    (^^)     E        ("'^:*^  )(-.i  )■'    [>!;(>■(  J+k-2 ))  f. 

j=0  ^ 


Proof  of  Theorem  5.5.1 


By  Lemma  5.3.1,  we  need  only  find   lim  C[M(t)/t}   to  complete 
the  proof . 

Recall  that 

00 

M(t)  =  E  U(t  -  cTj^.). 
j=0        J 

Let   V^  =  "  1   and  V.  =  cr^ .  -  o^._      (j  >  2).   By  Theorem  5.2.1(c), 

O^  .    is  the  time  until  the  j-th  balk  occurs  in  the  queue  G  /M/=°  with 

balking  at  queues  of  length   [S/v ]  -  1.   The  results  of  Chapter  3  apply 

here,  with 


K  =  [s/v J, 
c)  =  G^(x), 

cpO)  =  [KQ)]' 


F(x)  =  G^(x),   and 
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From  Theorem  3.3.2,  V7c  therefore  have  M(t)  is  a  delayed  renewal 
process.   By  the  Elementary  Renewal  Theorem,  Prabhu  (1965a), 

lim  e{M(t)/t}  =  1/v  §  ^i(v). 

-  -J^— *  00 

The  quantities  used  in  calculating   iJ.(v)  follow  from  equations  (3.2.6) 
and  (3.2.S).   The  proof  is  now  complete. 

Writing  (5.5.2)  out,  we  see  that  C(v)  is  minimized  when 

h^(v)  =  (l/v){l  +  CC^/C^VAiv)]  (5.5.3) 

is   minimized.      Therefore,    h   (V)    can   be    considered    as    the   cost   function 
of    interest . 

Example:      Poisson    Demand 

Assume,   the    item-by-item  demand    for    objects    in   the  subwarehouse 
occurs    according   to  a   Poisson   process   with    intensity    |i'.      Then 

Pr{D(t)    =   n]    =   e"^^    (^^t)Vn•.    ,      n   ^  o, 

and   the    inter-demand   tim.es    have    the   distribution 

Pr[T  .  _T  .    ^^  x]    =  G(x)   =    1   -   e"^^,  x   ^  0,      j   ^   2.      (5.5.4) 

That  is,  we  have  the  ordering  scheme  (M,M,S , v,") . 
Define  p  =  ^/^ •   From  (5.5.4),  we  have 

1^(6)  =  (1  +  e/^i)-^. 

Hence,  iJ.(v)  of  Theorem  5.5.1  becomes  a  function  of 

n^^)  =  (1  +  n  \A0'-^(1  +  n/p)'\ 
which  is  a  function  only  of  p  and  not  M-  and  \   separately. 
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As    an    illustration,    Tabic    5.2    gives    the  values    of    h    (v)    of 
equation    (5.5.3)    for   C  /C^   =    10.0   and   various   values   of  p    and  S. 
Once  again,    considerable   savings   can  be   effected  by   the   proper   choice 
of   V,    the   lot   size   ordered. 

Comparison   of   Sections    5.4   and    5.5 

We   note   that   Sections    5.4   and    5.5   both  deal   with   inventories 
subject   to  general    demand   and  negative   expoenetial    regular   service 
times.      Whereas    the   results    of  Section   5.4   are  based   on   orders   being 
placed   to   a   one-server  v/arehouse,    Section   5.5   assumes   we  have   an 
infinite-server  warehouse  so   that   processing   of   an  order  begins   as    soon 
as    it    is   received. 

These   two  sections    represent    the   extreme   cases    in  terms    of   the 
number   of   processors    available   in   a  warehouse   to  process   an   order  when 
we   have  general    item-by- item   demand   and  negative   exponential    service 
times.      Therefore,   we   can   calculate   the   optimal    value   of   v,    the    lot 
size   ordered,    for   the  best    possible  situation    (processing   begins    inune- 
diately  when   an   order    is    placed.   Section   5.5)   and   the  worst    possible 
situation    (an   order  must  wait    in   turn  before   processing  begins, 
Section   5.4). 

It    is   worthwhile  to   compare  Tables    5.1    and   5.2   for   the   case 
of    Poisson    itera-by-item   demand. 
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TABLE    5.2 


VALUES    OF    h^(v)    FOR  THE    ORDERING   SCHEME    (M,M,S,v,o=) 


C^/Cq   =10.0 


s 

8 

9 

10 

V  N. 

0.8 

1.2 

0.8 

1.2 

0.8 

1.2 

1 

1.0002 

1.0021 

1.0000 

1.0003 

1.0000 

1.0000 

2 

0.5044 

0.5234 

0.5044 

0.5234 

0.5001 

0.5014 

3 

0.6260 

0.8743 

0.3406* 

0.3654* 

0.3406 

0.3654 

4 

0.3475* 

0.4713* 

0.3475 

0.4713 

0.3475 

0.4713 

5 

2.2000 

2.2000 

2  .2000 

2.2000 

0.2347* 

0.2966* 

6 

1.8333 

1.8333 

1.8333 

1.8333 

1.8333 

1  .8333 

7 

1.5714 

1.5714 

1.5714 

1.5714 

1.5714 

1.5714 

8 

1.3750 

1.3750 

1.3750 

1.3750 

1.3750 

1.3750 

9 

1.2222 

1.2222 

1.2222 

1  .2222 

10 

1.1000 

1.1000 

Denotes    optimal   value. 
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5.6     Solution   of    C(v)    Using   the   Queue  GI/D/1 

with   Balking 


In   this   section,   we   consider   the  solution   o£    C(v)   for   the 
ordering   scheme    (G,D,S,v,l). 

The   subwarehouse  places    orders    of    lot   si^e  v  with  a   one-server 
warehouse   so   that   orders   arrive   at   the  warehouse,    form  a    queue,    and   are 
processed   on   a   strict    "first   come,    first   served"  basis.      We   allow   the 
item-by-item  demand   function   D(t)    to  be   general,    but  we   require  that 
regular   orders    have   a   constant   service   time  b.      It   may  be  that   b    is 
a   function   of   v,    the   lot   size   ordered.      Typically,   we  may  allow  for   this 
by   permitting      b   =   vd,    da    constant- 

By   Lemma    5.3.1,    we   need   only    find      lira     S{M(t)/t}      to   complete 
the   solution   of   the   cost    function   CC"^)   defined    in  Section   5.3. 

Recall    that 

CD 

M(t)    =     E      U(t    -  °ii.J' 
j  =  l  ^ 

From  Theorem   5.2.1(c),    Oy^ ,    is    the   time   until    the    j-th  balk   occurs    in   the 

queue     G  A'/l      with  balking   at    queues    of    length      [S/v]   -    1.      Hence,    the 

results    of   Chapter  U   apply   here  with      K  =    [SA  ]   and   the   distribution   on 

inter-arrival    times    F(x)   =  G    (x). 

Except  for  the  trivial  case   [S/v]  =  1  when  M(t)  =  N(t), 

it  was  noted  in  Section  ^■.3   that  the  random  variables 

Vj  =  a,.  -a,._^.      j.2, 

do  not  have  the  property  of  identical  distribution  as  was  the  case  when 
the  service  times  had  a  negative  exponential  distribution.   Therefore, 
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M(t)  is  not  a  renewal  process  and   6-{MCt)/t}  does  not  possess  a  simple 

limit.   Since  wc  are  interested  in  the  long  run  behavior  of  the  inventory, 

we  shall  be  content  to  utilize  the  steady  state  properties  of  the  system 

and  to  redefine  M(t)  so  that  a  suitable  limit  for   £{M(t)/t}  can  be 

obtained  - 

Recall  the  definition  of  o      from  Section  5-1.   It  is  clear  that 

n 

Cf      is    a   function   of   v,    the   lot   size   ordered.      Define 
n 

S(v)=nb-cr,  n^l, 

n  n 

and 

M*(y;v)    =    inf    [n  >  o|s    (v)   ^    -y   or  S    (v)  >    [S/v ]    _   2    -    y] , 

[S/v]   >   3. 

Furthermore,    let      iY.(v);    j    =    1,2,3,...]      be    the   Markov  process    defined 
by    (4.3.18).      Y.    is  written   as   Y.(v)   to   emphasize   the  dependence   of   the 
process    on   v,    the    lot    size   ordered,    when   the    quantities    K  and   F(x)    of 
Chapter   4   are      [S/v]      and  G    (x),    respectively. 

Denote   by   F    (y,v)    the   stationary  distribution   of   Y.(v)   so 
that   F    (y,v)   satisfies 

([S/v]-l)b 
FyCy,v)    =  J  PrlY^Cv)   ^    y|Y^(v)    =   x}    d^F^Cx.v), 

([S/v]-2)b 


([S/v]   _    2)b  <  y  ^    ([SA]   -    l)b. 
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Finally,    let 

■ 

^i(v)   -   1,      [S/v]  =1, 

=    1    +  /    [1    -   G^(y-0)]/G^(b-0)    dF^Cy.v),  [S/v]    =   2, 

=  /  e(M*(y-b;    V))   dFy(y,v) 

+    [f.(M*(0;    v))/Pr{S|^*^Q.    ^^(v)  >    ([s/v]    -   2)b]] 

■   /  ^^'^^M*(y-b;    v)^"^   ^    -   y    +   b}    dF^Cy.v),       [S/v  ]   >   3.         (5.6.1)      j 

If   Y   (v)    possesses    the  stationary  distribution   F   (y,v),    then 

i 
by  Theorem  4.3.4,    '^iCv)    is    one   plus    the  expected   number   of    orders    of    lot  1 

si^e  V   that   occur  between   any   two   emergency    orders   when   the    inventory  ' 

i 
system    is    in    the   steady   state.  1 

*        *        * 
Let    V   ,    V    ,    V    ,  ...,    be   a  sequence   of   mutually   independent 

12         3  '  i 

*  I 

random  variables   such   that    the   distribution   of   V.    is  \ 

J  \ 

•[V*  s  x}  =  /  Pr[v._^^  S  x|y.(v)  =  y]  dFY(y,v),     j  ^  1.  : 


* 

Pri 


*   *   * 
By  Theorem  4.3.4,  V  ,  V  ,  V  ,  ...,  are  identically  distributed  and  repre- 
sent the  time  between  successive  emergency  deliveries  when  the  system  is 
in  the  steady  state.   For  the  purposes  of  this  section,  we  redefine. 
M(t)  as 

00 

M(t)  =   E   U(t  -  V*  -  ...  -  V*),  (5.6.2) 

so  tiiat   M(t)    is    the  number   of   emergency  deliveries   during    [0,t]  when 
the    inventory  system   is    in   the  steady  state. 
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Theorem  5.6.1 

For  the  ordering  scheme  (G,D,S,v,l),  the  cost  function  C(v) 
of  Section  3.3  (with  M(t)  redefined  by  (5.6.2))  has  the  form 

C(v)  =  (Cq  +  C^)/§  V  +  C^/v  §  ii(v)  (5.6.3) 

with 

00 

§  =  J  u  dG(u) 
o 

and  l-i(v)  given  by  (5.6.1). 
Proof  of  Theorem  5.5.1 


By  the  Elementary  Renewal  Theorem,  Prabhu  (1965a), 

lim    e{M(t)/t}  =  i/e(v*) 

t-  <=^ 

=  1/v  5  ti(v), 

* 

the  last  equality  following  from  Theorem  4.3.2  and  the  definition  of  V.. 

Applying  Lemma  5.3.1,  we  complete  the  proof. 

Writing    (5.6.3)    out,   we   see   that   C(v)    is   minimized  when 

h2(v)   =    (l/v)[l    +    (C2/C^)A'.(v)}  (5.6.4) 

is  minimized,  h  (v )  nay  therefore  be  taken  as  the  cost  function  of 
interest. 

In  many  cases  it  may  be  difficult  to  obtain  \i.(^)   when  [S/v  J  >3. 
Theorem  4.3.3  then  gives  a  bound  that  may  be  used  to  obtain  an  approx- 
imate lower  bound  for  C(v). 


CHAPTER  6 

THE  INVENTORY  PROBLEM:   CONTINUOUS  CASE 

6.1    First  Passage.  Times  of  Non-Negative, 

Continuous"  Stochastic  Processes  with 

InfinTtely  Divisible  Distributions 

In  this  chapter,  we  wish  to  consider  the  ordering  scheme  for 
a  subwarehousc  that  maintains  an  inventory  of  fluid  material.   We  assume 
the  demand  for  the  fluid  in  storage  occurs  continuously.   It  is  reason- 
able to  further  assum.e  that  the  demand  during  any  interval  of  time  is 
independent  of  the  demand  during  any  other  nonoverlapping  interval  of 
time  and  that  the  probability  law  for  the  demand  during  any  interval 
[s,  s+t]  is  functionally  dependent  only  on  the  length,  t,  of  the  inter- 
val.  Hence,  if   [oCt);  t  =^  O]   is  the  stochastic  process  such  that 
D(t)  represents  the  demand  for  the  fluid  in  storage  during  the  time 
interval   [O,  t],  then  we  are  assuming  that   [oCt);  t  >  o]   is  a  non- 
negative,  continuous  stochastic  process  with  stationary,  independent, 
nonoverlapping  increments.   By  Theorem  2  of  Feller  (1966,  p.  29iO  ,  this 
is  equivalent  to  stating  that   {D(t);  t  ^  O]   is  a  non-negative,  contin- 
uous stochastic  process  whose  distribution  is  infinitely  divisible. 
The  distribution  function  of  D(t)  will  be  denoted  by 

Pr{D(t)  ^  x]  =  J   g(y,t)  dy,      X  s  0,    t^O,  (6.1.1) 

o 

with  g(-,t)  a  density  on  [0,")  for  each   t  ^  0. 
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In  the  next  section,  a  complete  description  of  the  ordering 
scheme  used  to  replenish  the  inventory  will  be  given.   To  solve  this 
inventory  problem,  v;e  need  the  probability  law  for  the  stochastic 
process   [t(u);  u  >  0}   defined  by 

T(u)  =  inf  {t|D(t)  s  u}  (6.1.2) 

(so   that   T(u)    is    the   first   passage   time   of    D(t)    into  the    interval 
[u,'=°)).      The  rest   of   the   current   section  will   be   devoted   to  properties 
of  T(u) . 

Theorem   6.1.1 


Let      {t(u);    u  >   O]      be  the   stochastic   process    defined   by    (6.1.2), 
then 

(a)  T(u)    has    stationary,    independent,    noncver lapping    increments, 
and 

(b)  The   distribution   of   T(u)    is 

m 

Pr{T(u)  ^   t}    =  /     g(y,t)   dy,  t   s  0,      u  >  0. 

u 

Proof  of  Theorem  6.1.1 


Since  T(u)  ^  t  if  and  only  if  D(t)  ^  u, 
Pr[T(u)  s  t]  =  Pr{D(t)  ^  u] 

CO 

=  /  g(y,t)  dy, 
u 
completing  part  (b)  of  the  proof. 

To  prove  part  (a),  it  is  sufficient  to  show 

Pr[T(y)  -  T(w)  ^  s|t(w)  =  r]  =  Pr{T(y-w)  ^  s]  (6.1.3) 

for  all  s  >  0,  r  >  0,  and  0  ^  w  <  y. 
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First  we  shall    calculate      Pr{T(y)  ^    t|T(w)    =   r}      for  w  <  y  and 
r  <  t.      Now,    Pr[T(w)    =    r}    =    0      so   that      Pr{T(y)  =="    t|T(w)    =    r]       involves 
conditioning   on   an   event   o£   probability   zero.      Hence,    the   quantity 
Pr{T(y)  ^'   t,   T(w)   =   r}/Pr{T(w)   =   r}      is    undefined   and   therefore   can  not 
be   used   to  define     Pr{T(y)   ^   tlTCw't    -   r]  .      Cramer  and   Leadbetter    (1967, 
pp.    219-222)   give   two   plausible  definitions    for      Pr[T(y)  ^t|T(w)    =   r] 
which   are   knovm   as    the   vertical-window    (v.w.)    and   horizontal-window    (h-w.) 
conditional   probabilities.      These   conditional    probabilities    are  defined   by 

Pr[T(y)  s    tJTCw)    =   r] 

■'  v.w. 

=    lim      Pr[T(y)   ^    t|r  ^   T(w)    ^    r    +   5}  (6.1.4) 

6-'  0 
and 

Pr[T(y)  ^   t|T(w)   =   r}^_^_ 

=    lim      PrfT(y)   ^    t|T(T)    =    r, 
6-  0 

for   some  t    e    [w,w+o]},  (6.1.5) 

respectively.      Both   (6.1.4)   and    (6-1.5)   define  Pr[T(y) ^ t| T(w)   =   r] 
in   terms    of   a    limit   of   conditional    probabilities   which   involve   condi- 
tioning  on   events    of   non-zero   probability.      Equation    (6.1.4)    is    the 
usual   definition   of      Pr{T(y)   ^   t|T(w)    =   r]  .      However,    in   our   particular 
case    (6.1.4)    leads    to  an   undefined   quantity.      Therefore,   we   choose   to 
use   the  horizontal-window   definition   given  by    (6.1.5).      We   have,    for 
0    <    6    <    y-w, 
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Pr{T(y)   S    tJTCw)    -    i]. 


PrfT(y)^   t,    T(T)    =   r   for   some   T    e    [w,w+6]} 

1  LRl        : — 

6-0  Pr{T(T)   =   r   for   some  t    e    [w,w+6]] 

Pr{D(t)   ^  y,   w  ^   D(r)  ^  w   +   6} 

1  im — 

5_  Q  Pr[w  ^   D(r)   ^  w  +  i>] 

oo       V7  +  6 

J      J         g(z-x,t-r)    g(x,r)    dx   dz 
1  im       V     w 


6-»  0  w+6 

/  g(x,r)   dx 

w 


I      g(z-w,t-r)    dz[g(w,r)/g(w,r)] 

y 


=  /        g(z,t-r)   dz 
y-w 

=   Pr[D(t-r)   ^  y-w} 

=   Pr{T(y-w)   S    t-r}.  (6.1.6) 

Let   t   =   r+s      in   equation    (6.1.6),    then 

Pr{T(y)    -   T(w)   S   s|t(w)    =   r}, 

=  Pr{T(y)  S   s+r|T(w)    =   r} 

=    Pr[T(y-w)  <   s}, 

thus    completing   the   proof. 

The   above   theorem    implies    that    T(u)    is    also   non-negative  with 
an    infinitely   divisible   distribution.      Hence,    the  Laplace    transforms    of 
T(u)    and   D(t)    have   the    forms 
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eCe-®^^"^   =   e-"^*^^^  e>0,  (6.1.7) 

and 

eCc-^^^^^   ^   e-^^'^^  e>0,  (6.1.8) 

respectively,    such  that  w(9)   and   v(6)   are   positive   for      6>   0      and 
possess    completely  monotone   derivatives.      See,    for   example,  Feller    (1966) 

An   attempt  was   made   to   find   the   relation  between   the  Laplace 
transforms    of    (6.1.7)    and    (6.1.8)   by   utilizing   the   following   technique. 
We   have 


and 


J     J     e  ^"^   e      ^   PrfKy)  ^   t]    dt   dy 
o      o 

=  f  ^-9y  e-"^^^y/§    dy 
o 

=    l/[§(e+w(§))],  (6.1.9) 

O  CD 

J     J     e"^^   e"^^  PrrD(t)   ^  y   }    dy   dt 


o      o 


r    -5t  .,       -v(e)t.  .Q  ,^ 

J      e  (1    -   e  )/y  dt 


i/§e  -  i/[e(§  +  v(9))] 

v(e)/[e§(§  +  v(8))].  (6.1.10) 


Now     Pr[D(t)   ^  y]    =   Pr{T(y)  ^   t]      so   that  _if_ 

00  00 

J     /     e'^^  e'   ^  PrfD(t)  ^  y]    dy  dt 


o      o 


03  03 

=  11     ^'^^   e"   ^  PrrD(t)   =i   y}    dt   dy  (6.1.11) 


o      o 


9/+ 


(i.e.,  if  we  can  change  the  order  of  integL-ation) .  then  (6.1.9)  and 
(6.1.10)  must  be  identical.   Hence,  we  have 

l/[§(9  +  w(§))l  =  v(9)/[§  e(§  +  vO))] 


or 


which   implies 


v(e)  w(§)  =  e  § 


w(5)  =  c  ^' 


ana 


V(G)  =  9/c 
for  some   c  >  0.  We  must  have  by  the  uniqueness  of  Laplace  transforms 


that 


Pr{D(t)  -  t/c]  =  Pr{T(y)  -  cy]  =  i. 


It   now  seems    that    the   only  non-negative,    continuous    process    D(t)   with 
stationary,    independent,    nonoverlapping    increments    is    the   tri/ial    deter- 
ministic model      D(t)    =   t/c.      However,    we   know  that    if    D(t)    has    the  gamm.a 
density 

g(y,t)=  e"^/^    y''"Vr(t)p\  y  ^  0,  (6.1.12) 

then  D(t)  is  non-negative;  continuous;  has  stationary,  independent, 
nonoverlapping  increments;  and  is  clearly  not  deterministic.   The  point 
we  make  is  that  (6.1.11)  is  true  only  for  the  trivial  case   D(t)  =  t/c 
and,  hence,  the  order  of  integration  can  not  be  changed  for  any  other 
choice  of  D(t).   So  far  we  have  been  unable  to  find  a  suitable  method 
for  obtaining  the  Laplace  transform  of  T(u). 
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Since  wc  would  like  as  much  iiu'ormation  about  T(u)  ar,  possible, 
it  seems  reasonable  to  try  to  calculate  C(TCu)).   By  (6.1.7)  and 
(6.1.8),  it  is  clear  that 

e(T(u))  =  u  f'(T(i)) 
and 

e(D(t))  =  t  £(0(1)). 

Now,  by  Lemma  1  of  Feller  (1966,  p.  148), 


e(T(u))  -•  /   [1  -  Pr{T(u)  ^  t}]  dt 


J  Pr{D(t)  ^  u]  dt 


/  J"  g(y.t)  dy  dt, 


o  o 


so  that 


CO    I 

£(7(1))=/  J  g(y,t)  dy  dt.  (6.1.13) 


o   o 


It  is  strongly  suspected  that 

£(1(1))  =  1/£(D(1)),  (6.1.14) 

although  all  attempts  to  prove  (or  disprove)  this  fact  have  failed. 

It  is  obvious  that  many  questions  remain  unanswered  about  the 
process  T(u).   Possible  areas  of  future  research  include  finding  the 
specific  form  of  (6.1.7),  which  would  completely  solve  the  problem,  or 
at  least  establishing  (6.1.14). 
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6.2   De£inLtion  of  the  Continuous  Inventory  Syst e m 
and  Its  Relation  to  Previous  Results 


The  inventory  problem  for  the  case  when  we  have  continuous 
demand  is  analogous  to  the  description  for  the  discrete  case  given  in 
Section  5.1.   The  biggest  difference  is  that  V,  the  size  of  an  order  of 
replacement  fluid,  is  not  constrained  to  be  an  integer.   V7e  now  discuss 
the  system  in  detail. 

Consider  a  subwarehouse  that  maintains  a  reservoir  (inventory) 
of  fluid  material.  The  capacity  of  the  reservoir  is  S ,  a  positive  real 
number.   The  fluid  in  the  reservoir  is  continuously  being  depleted  by 
its  use  in  some  process. 

Let   [D(t);  t  >  Oj   be  the  stochastic  process  which  represents 
the  demand  for  the  fluid  in  storage.   In  keeping  with  the  constraints 
placed  on  D(t)  in  Section  6.1,  we  assume  D(t)  is  non-negative,  contin- 
uous, and  has  an  infinitely  divisible  distribution.   The  distribution 
function  of  D(t)  will  be  given  by  (6.1.1). 

In  order  to  maintain  a  positive  level  of  fluid  on  hand,  the 
subwarehouse  places  an  order  for  an  amount  v  (0  <  V  ^  S )  of  replacement 
fluid  to  a  warehouse.   It  will  be  held  that  the  orders  are  placed  at 
the  times   a   a       a  ,  ..,,  where 

cr.  =  inf  ft|D(t)  s-  jv],     j  >  1.  (6.2.1) 

By  Theorem  6.1.1,    the   random  variables      cr     _  ct^  ,    a     _  cr        ^a.  "  '^•^'  '  '  ' ' 

are  mutually   independent   and      o.  _  cr .    ,    has   the  distribution   function 

J        3-1 
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Pr{a.  -  a         :^  t]    =   PrfD(t)  ^  v]  j 

J    J-1  j 

~  ; 

=  J   g(x,t)  dx,   t  ;>  0,  2-2.  (6.2.2)    < 

V 

Let   [S(t);  t  >  0}   be  the  stochastic  process  such  that  S(t)        \ 

represents  the  level  of  fluid  in  the  reservoir  at  time  t.   We  then         * 

define 

S(t)  =  S  -  D(t)  +  vR(t)  (6.2.3) 

where  R(t)  is  the  number  of  orders  that  have  been  filled  by  the  ware- 
house for  our  subwarehouse  of  interest  during  the  interval  [0,tj. 

As  before,  an  order  placed  at  time  cr  may  be  one  of  two  types. 
We  have  a  regular  order  if  SCo)   >  S  -  v[S/v].   In  this  case,  the  time 
to  fill  an  order  (hereafter,  the  service  time)  is  assumed  to  be  a 
random  variable,   rho  successive  regular  service  times,  denoted  by 
w  ,  w  ,  w  , ...,  are  assumed  to  be  mutually  independent  and  independent 
of  the  demand  process  D(t) .   The  distribution  of  w.  is  given  by 

Pr[w.  s  „]  =  H(w),  •   w  5  0,   j  ^  1.         (6.2.ii) 

We  have  an  emergency  order  if  S(c)  =  S  -  v[s/v].   In  this  case, 
S(0+0)  =  S  -  v[S/v]  +  Vj  so  that  the  emergency  service  time  is  assumed 
instantaneous,  or  at  least  effectively  zero.   Utilizing  this  ordering 
technique,  the  reservoir  maintained  by  the  subwarehouse  is  never  depleted. 

Realistically,  the  time  to  process  a  regular  order  should  depend 
in  some  manner  on  v,  the  quantity  being  ordered.   Therefore,  one  may 
have  H(w)  a  function  of  v. 
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We   assume   the  subwarehouse   places    its    orders   with  either 
a   one-server   or    infinite-server  warehouse    as    described    in   Section    5.1. 
Define 

F(t,v)    =    Pr[D(t)    ^  v] 

00 

=  J     g(x,t)    dx,  t   >   0,  (6.2.5) 

V 

so   that      F(.,v)      repr-esents   the  distribution   function   of   ^.    _   o.    ^  . 

J    J-1 

As  before,  we  seek  that  value  of  V,  the  size  of  the  replacement  order, 
such  that  the  cost  function   C(v)  defined  in  Section  5.3  is  a  minimum. 
If  we  replace  the  distribution  functions  G(-)   and  G  (•)  of  Chapter  5 
by  F(-,l)   and  F(.,v),  respectively,  then  all  results  of  Sections  5.2 
through  5.6  hold  for  our  continuous  inventory  problem.   One  can  easily 
change  the  terminology  of  Definition  5.1.1  so  that  it  expresses  the 
ordering  scheme  for  maintaining  the  level  of  fluid  for  an  inventory 
problem  of  the  continuous  type.  The  main  point  to  remember  is  that  v/e 
are  now  minimizing  C(v)  over  all  choices  of  v  in  the  interval  (0,S]  and  v.'e 
are  not  restricted  to  the  integral  values  of  v  as  was  the  case  in  the 
last  chapter. 

An  important  and  realistically  relevant  example  of  D(t)  is  when 

e(e-'°^^^  =  (1  -  ep)-t 

=   exp    (-t   ln(l    +   9  p)) . 

That    is,    when    D(t)    has    a  gamma    distribution  with  parameters   p    and   t- 
In   this    case, 

00 

-X        t-1 


F(t,v)    =  J        e""^   x^      /Tit)    dx.  (6.2.6) 

v/p 
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However,  no  expression  for 

-et 


1^(6)  -  J  e"  ^  dF(t,l) 


o 


could  hi-   obtained.   Therefore,  we  are  unable  to  give  an  exati'ple  of 
the  calculations  involved  in  utilizing  Sections  5  Ji  through  5.6. 

The  study  of  the  distribution  function  given  by  (6.2.6)  is  an 
area  of  possible  future  research. 
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